A method for intelligent automatic repair of three-dimensional scanning of paper documents

Abstract

The present invention discloses a method for intelligent automatic repair of three-dimensional scanning of paper documents, and relates to the technical field of document data processing. The method comprises the following steps: collecting three-dimensional scanning parameters of paper documents; performing a first performance evaluation of three-dimensional scanning of paper documents and a second performance evaluation of three-dimensional scanning of paper documents according to the three-dimensional scanning parameters of paper documents; performing comparative analysis based on the three-dimensional scanning performance evaluation results of paper documents and a preset three-dimensional scanning performance threshold of paper documents; and adjusting the three-dimensional scanning of paper documents according to the comparative analysis results of the three-dimensional scanning performance of paper documents. The present invention improves the quality of data collected by three-dimensional scanning of paper documents by evaluating and analyzing the three-dimensional scanning parameters of paper documents and adjusting the three-dimensional scanning mode of paper documents, improves the accuracy for the subsequent generation of the final three-dimensional model of paper documents, and solves the problem of low quality of data collected by three-dimensional scanning of paper documents in the prior art.

Description

Technical Field

[0001] The present invention relates to the technical field of document data processing, and in particular to an intelligent automatic repair method for three-dimensional scanning of paper documents. Background Art

[0002] With the development of social informatization, more and more paper documents will need to be digitized for long-term preservation and wide sharing. Intelligent automatic restoration technology will enable a large number of damaged paper documents to be effectively repaired, promoting the protection and inheritance of cultural heritage. At the same time, the wide availability of digital documents will greatly facilitate education and academic research.

[0003] Existing methods for intelligent automatic repair of three-dimensional scanning of paper documents are implemented in the following ways, including: optical scanning, laser scanning and camera-based scanning systems; edge detection, morphological operations, and image repair technology.

[0004] For example, an image text detection method announced in the invention patent with announcement number: CN104200209B includes: based on a new step process design, it has a wider range of applications and a higher detection rate. It is no longer limited to the detection of black text on a white background or white text on a black background in scanned documents. It can detect text on images in various scenes with complex environments, such as photos, handwritten text, etc., and has higher work efficiency.

[0005] For example, the invention patent announcement with announcement number: CN103927533B discloses an intelligent processing method for graphic information in early patent document scans, including: converting the input patent document scan image into a binary two-dimensional matrix and removing the granular noise in the scan image, that is, using an algorithm to circle the cutting target with a rectangular frame to obtain a number of coarse blocks, classifying each coarse block, marking and obtaining a number of text blocks and a number of non-text blocks. Further fine cutting operations are performed on the non-text blocks to obtain a number of fine blocks. Each fine block is classified, marked and obtained to obtain a number of numbered blocks and a number of non-numbered blocks. The non-numbered blocks are classified, marked and obtained to obtain a number of impurity blocks and a number of illustration blocks. Corresponding matching is performed on the numbered blocks and the illustration blocks, that is, matching the specified illustration with the corresponding figure number.

[0006] However, in the process of implementing the technical solution of the invention in the embodiments of the present application, the present application found that the above technology has at least the following technical problems:

[0007] In the prior art, for documents in special formats, such as scrolls, folding books, etc., the intelligent automatic repair method of three-dimensional scanning may result in low data collection quality during the original data collection stage due to various problems such as aging, mildew, and folding of the paper documents. This results in low data collection quality for three-dimensional scanning of paper documents. Summary of the invention

[0008] The embodiment of the present application solves the problem of low quality of data collected by three-dimensional scanning of paper documents in the prior art by providing a method for intelligent automatic repair of three-dimensional scanning of paper documents, thereby achieving the effect of improving the quality of data collected by three-dimensional scanning of paper documents.

[0009] The embodiment of the present application provides a method for intelligent automatic repair of three-dimensional scanning of paper documents, comprising the following steps: collecting three-dimensional scanning parameters of paper documents; performing a first performance evaluation of three-dimensional scanning of paper documents and a second performance evaluation of three-dimensional scanning of paper documents according to the three-dimensional scanning parameters of paper documents, to obtain a three-dimensional scanning performance evaluation result of paper documents; performing a comparative analysis of the three-dimensional scanning performance evaluation result of paper documents with a preset three-dimensional scanning performance threshold of paper documents, to obtain a three-dimensional scanning performance comparison analysis result of paper documents; adjusting the three-dimensional scanning of paper documents according to the three-dimensional scanning performance comparison analysis result of paper documents; and performing three-dimensional scanning of paper documents and intelligently and automatically repairing the three-dimensional scanning of paper documents according to the adjusted three-dimensional scanning of paper documents.

[0010] Furthermore, the specific process of collecting the three-dimensional scanning parameters of paper documents is: performing three-dimensional scanning on paper documents through a three-dimensional scanning device, collecting and obtaining the three-dimensional scanning parameters of paper documents; the three-dimensional scanning parameters of paper documents include scanning area parameters, paper document area parameters, paper document light intensity parameters, paper document three-dimensional scanning resolution parameters and paper document three-dimensional scanning color difference parameters; the scanning area area parameters are obtained by the maximum scanning surface area parameters of the three-dimensional scanning device, the paper document area parameters are obtained by measuring the area of ​​the paper document itself, the paper document light intensity parameters are obtained by measuring with a photometer, the paper document three-dimensional scanning resolution parameters are obtained by the maximum scanning resolution of the three-dimensional scanning device, and the paper document three-dimensional scanning color difference parameters are obtained by measuring with a colorimeter.

[0011] Furthermore, the specific process of obtaining the paper document three-dimensional scanning performance evaluation result is: according to the scanning area parameter, paper document area parameter and paper document light intensity parameter in the paper document three-dimensional scanning parameters, the first quality risk index of paper document restoration scanning data is obtained by evaluation and analysis; according to the paper document light intensity parameter, paper document three-dimensional scanning resolution parameter and paper document three-dimensional scanning chromatic aberration parameter in the paper document three-dimensional scanning parameters, the second quality risk index of paper document restoration scanning data is obtained by evaluation and analysis; according to the first quality risk index of paper document restoration scanning data and the second quality risk index of paper document restoration scanning data, the third quality risk index of paper document restoration scanning data is obtained by comprehensive analysis.

[0012] Furthermore, the specific process of obtaining the first quality risk index of the paper document restoration scanning data is: numbering the three-dimensional scanning areas of the paper document in sequence to obtain the three-dimensional scanning area numbers of the paper document; numbering the first detection time points of the three-dimensional scanning of the paper document in sequence to obtain the first detection time point numbers of the three-dimensional scanning of the paper document; annotating the paper document light intensity parameters, paper document three-dimensional scanning resolution parameters and paper document three-dimensional scanning color difference parameters according to the three-dimensional scanning area numbers of the paper document and the first detection time point numbers of the three-dimensional scanning of the paper document, respectively, to obtain the paper document light intensity annotation parameters, paper document three-dimensional scanning resolution annotation parameters and paper document three-dimensional scanning color difference annotation parameters; thereby analyzing and obtaining the first quality risk index of the paper document restoration scanning data.

[0013] Furthermore, the specific process of obtaining the second quality risk index of the paper document restoration scanning data is: numbering the three-dimensional scanning areas of the paper document in sequence to obtain the three-dimensional scanning area numbers of the paper document; numbering the chromatic aberration scanning detection areas in the three-dimensional scanning area of ​​the paper document in sequence to obtain the chromatic aberration scanning detection area numbers in the three-dimensional scanning area of ​​the paper document; data annotation of the paper document light intensity parameters, the paper document three-dimensional scanning resolution parameters and the paper document three-dimensional scanning color difference parameters according to the three-dimensional scanning area numbers of the paper document and the chromatic aberration scanning detection area numbers in the three-dimensional scanning area of ​​the paper document, to obtain the paper document light intensity annotation parameters, the paper document three-dimensional scanning resolution annotation parameters and the paper document three-dimensional scanning color difference annotation parameters; thereby analyzing and obtaining the second quality risk index of the paper document restoration scanning data.

[0014] Furthermore, the specific process of obtaining the third quality risk index of the paper document restoration scan data is: obtaining the third quality risk index of the paper document restoration scan data according to the comprehensive analysis function of the first quality risk index of the paper document restoration scan data and the second quality risk index of the paper document restoration scan data; the specific comprehensive analysis function is as follows: η1+η2=1; ξ represents the third quality risk index of paper document restoration and scanning data, e represents a natural constant, ψ represents the first quality risk index of paper document restoration and scanning data, λ represents the second quality risk index of paper document restoration and scanning data, η1 is the first influencing factor of the third quality risk index of paper document restoration and scanning data obtained from the paper document three-dimensional scanning database, and η2 is the second influencing factor of the third quality risk index of paper document restoration and scanning data obtained from the paper document three-dimensional scanning database.

[0015] Furthermore, the specific process of obtaining the comparative analysis results of the three-dimensional scanning performance of paper documents is as follows: if the third quality risk index of the paper document restoration scanning data is less than a preset paper document three-dimensional scanning performance threshold, the three-dimensional scanning method of the paper document is judged to be qualified and no adjustment is made.

[0016] Furthermore, the comparative analysis results of the three-dimensional scanning performance of paper documents also include: if the third quality risk index of the paper document restoration scanning data is not less than the preset paper document three-dimensional scanning performance threshold, then the paper document three-dimensional scanning method is judged to be unqualified; if the first quality risk index of the paper document restoration scanning data is not less than the preset first threshold of the paper document three-dimensional scanning performance or the second quality risk index of the paper document restoration scanning data is not less than the preset second threshold of the paper document three-dimensional scanning performance, then it is judged to be recorded as the first adjustment level of the paper document restoration scanning, and corresponding adjustments are made; if the first quality risk index of the paper document restoration scanning data is not less than the preset first threshold of the paper document three-dimensional scanning performance and the second quality risk index of the paper document restoration scanning data is not less than the preset second threshold of the paper document three-dimensional scanning performance, then it is judged to be recorded as the second adjustment level of the paper document restoration scanning, and corresponding adjustments are made.

[0017] Furthermore, the corresponding adjustments specifically include: if it is judged to be the first adjustment level for paper document restoration scanning, then increasing the single scanning area of ​​the three-dimensional scanning device, adjusting the exposure time of the three-dimensional scanning device, adjusting the exposure contrast of the three-dimensional scanning device, and adjusting the angle of multi-light source illumination of the three-dimensional scanning device; if it is judged to be the second adjustment level for paper document restoration scanning, then increasing the resolution accuracy of the three-dimensional scanning device and adjusting the filter type of the three-dimensional scanning device.

[0018] Furthermore, the specific process of performing three-dimensional scanning of paper documents and intelligently and automatically repairing them according to the adjusted three-dimensional scanning of paper documents is as follows: splicing the adjusted three-dimensional scanning data of paper documents obtained by scanning at multiple angles through three-dimensional scanning processing software, and removing data noise in the adjusted three-dimensional scanning data of paper documents to obtain a three-dimensional model of the paper document; applying a deep learning algorithm to extract features of the distorted area data in the three-dimensional model of the paper document, and performing intelligent repair according to the features of the distorted area data; transmitting and saving the intelligently repaired three-dimensional model of the paper document in a three-dimensional scanning database of the paper document.

[0019] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

[0020] 1. Collect paper document three-dimensional scanning parameters; perform a first performance evaluation and a second performance evaluation of paper document three-dimensional scanning according to the paper document three-dimensional scanning parameters; compare and analyze the paper document three-dimensional scanning performance evaluation results with the preset paper document three-dimensional scanning performance threshold; adjust the paper document three-dimensional scanning according to the paper document three-dimensional scanning performance comparison and analysis results, so as to improve the quality of paper document three-dimensional scanning data collection, improve the accuracy for the subsequent generation of the final paper document three-dimensional model, and solve the problem of low quality of paper document three-dimensional scanning data collection in the prior art.

[0021] 2. Based on the comparative analysis of the paper document 3D scanning performance evaluation results and the preset paper document 3D scanning performance threshold, the paper document 3D scanning performance comparative analysis results are obtained. According to different adjustment levels, the scanning process can be adjusted in a targeted manner, and the scanning parameters and equipment configuration can be optimized, thereby improving the efficiency of the method for intelligent automatic repair of paper document 3D scanning.

[0022] 3. By adjusting the three-dimensional scanning of paper documents, including increasing the single scanning area of ​​the three-dimensional scanning equipment, adjusting the exposure time, exposure contrast, multi-light source illumination angle, improving the resolution accuracy and adjusting the filter type, the scanning quality is improved and the scanning error is reduced. The intelligent automatic repair method for three-dimensional scanning of paper documents can be adapted to the characteristics of different documents, thereby improving the applicability of the intelligent automatic repair method for three-dimensional scanning of paper documents. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 A flow chart of a method for intelligent automatic repair of three-dimensional scanning of paper documents provided in an embodiment of the present application;

[0024] Figure 2 A schematic diagram of a function graph of the first quality risk index of paper document restoration scan data provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The embodiment of the present application solves the problem of low quality of data collected by three-dimensional scanning of paper documents in the prior art by providing a method for intelligent automatic repair of three-dimensional scanning of paper documents. By evaluating and analyzing the three-dimensional scanning parameters of paper documents and adjusting the three-dimensional scanning method of paper documents, the quality of data collected by three-dimensional scanning of paper documents is improved, and the accuracy of subsequent generation of the final three-dimensional model of paper documents is improved, thereby solving the problem of low quality of data collected by three-dimensional scanning of paper documents in the prior art.

[0026] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0027] like Figure 1 As shown, it is a flow chart of a method for intelligent automatic repair of three-dimensional scanning of paper documents provided in an embodiment of the present application, the method is applied to a method for intelligent automatic repair of three-dimensional scanning of paper documents, the method comprising the following steps: collecting three-dimensional scanning parameters of paper documents; performing a first performance evaluation of three-dimensional scanning of paper documents and a second performance evaluation of three-dimensional scanning of paper documents according to the three-dimensional scanning parameters of paper documents, to obtain a three-dimensional scanning performance evaluation result of paper documents; performing a comparative analysis of the three-dimensional scanning performance evaluation result of paper documents with a preset three-dimensional scanning performance threshold of paper documents, to obtain a three-dimensional scanning performance comparison analysis result of paper documents; adjusting the three-dimensional scanning of paper documents according to the three-dimensional scanning performance comparison analysis result of paper documents; performing three-dimensional scanning of paper documents and intelligently and automatically repairing the paper documents according to the adjusted three-dimensional scanning of paper documents.

[0028] In this embodiment, the first performance evaluation of three-dimensional scanning of paper documents is to evaluate and analyze to obtain a first quality risk index of paper document restoration scanning data, and the second performance evaluation of three-dimensional scanning of paper documents is to evaluate and analyze to obtain a second quality risk index of paper document restoration scanning data.

[0029] Furthermore, the specific process of collecting three-dimensional scanning parameters of paper documents is as follows: perform three-dimensional scanning on paper documents through three-dimensional scanning equipment, collect and obtain three-dimensional scanning parameters of paper documents; the three-dimensional scanning parameters of paper documents include scanning area parameters, paper document area parameters, paper document light intensity parameters, paper document three-dimensional scanning resolution parameters and paper document three-dimensional scanning color difference parameters; the scanning area area parameters are obtained by the maximum scanning surface area parameters of the three-dimensional scanning equipment, the paper document area parameters are obtained by measuring the area of ​​the paper document itself, the paper document light intensity parameters are measured by a photometer, the paper document three-dimensional scanning resolution parameters are obtained by the maximum scanning resolution of the three-dimensional scanning equipment, and the paper document three-dimensional scanning color difference parameters are measured by a colorimeter.

[0030] In this embodiment, the three-dimensional scanning equipment includes three-dimensional laser scanning technology: three-dimensional laser scanner, LED white light three-dimensional scanning technology, handheld laser three-dimensional scanning technology and tracking laser three-dimensional scanning technology.

[0031] Furthermore, the specific process of obtaining the paper document three-dimensional scanning performance evaluation results is as follows: based on the evaluation and analysis of the scanning area parameters, paper document area parameters and paper document light intensity parameters in the paper document three-dimensional scanning parameters, the first quality risk index of the paper document restoration scanning data is obtained; based on the evaluation and analysis of the paper document light intensity parameters, paper document three-dimensional scanning resolution parameters and paper document three-dimensional scanning chromatic aberration parameters in the paper document three-dimensional scanning parameters, the second quality risk index of the paper document restoration scanning data is obtained; based on a comprehensive analysis of the first quality risk index of the paper document restoration scanning data and the second quality risk index of the paper document restoration scanning data, the third quality risk index of the paper document restoration scanning data is obtained.

[0032] Furthermore, the specific process of obtaining the first quality risk index of paper document restoration scanning data is as follows: numbering the three-dimensional scanning areas of the paper document in sequence to obtain the three-dimensional scanning area numbers of the paper document; numbering the first detection time points of the three-dimensional scanning of the paper document in sequence to obtain the first detection time point numbers of the three-dimensional scanning of the paper document; annotating the paper document light intensity parameters, paper document three-dimensional scanning resolution parameters and paper document three-dimensional scanning color difference parameters according to the three-dimensional scanning area numbers of the paper document and the first detection time point numbers of the three-dimensional scanning of the paper document, respectively, to obtain paper document light intensity annotation parameters, paper document three-dimensional scanning resolution annotation parameters and paper document three-dimensional scanning color difference annotation parameters; thereby analyzing and obtaining the first quality risk index of the paper document restoration scanning data.

[0033] In this embodiment, the irregular shape of the surface of the paper document may lead to uneven illumination, causing some areas to be overexposed or too dark.

[0034] The first quality risk index of paper document restoration scan data is used to describe the level of negative impact of light on paper document restoration scan data for intelligent automatic restoration; the specific analysis formula is as follows:

[0035]

[0036] The three-dimensional scanning areas of paper documents are numbered in sequence, M0 represents the number of the three-dimensional scanning area of ​​paper documents, M0=1, 2, ..., M, and M represents the total number of the three-dimensional scanning areas of paper documents.

[0037] The three-dimensional scanning areas of different paper documents are different and overlap each other but are adjacent to each other.

[0038] A paper document three-dimensional scanning area is scanned once each time point of the first detection of the three-dimensional scanning of the paper document. There are multiple three-dimensional scanning first detection time points of the paper document in one paper document three-dimensional scanning area.

[0039] The first detection time points of the three-dimensional scanning of paper documents are numbered in sequence, Z0 represents the number of the first detection time point of the three-dimensional scanning of paper documents, Z0=1, 2, ..., Z, and Z represents the total number of the first detection time points of the three-dimensional scanning of paper documents.

[0040] ψ represents the first quality risk index of paper document restoration scanning data.

[0041] Represents the scanning area of ​​the Z0th paper document three-dimensional scanning area at the first detection time point of the M0th paper document three-dimensional scanning.

[0042] Represents the total area of ​​the M0th paper document.

[0043] It represents the maximum value of the standard deviation of the light intensity received by the paper document in the M0th paper document three-dimensional scanning area.

[0044] It represents the minimum standard deviation of the light intensity received by the paper document in the M0th paper document 3D scanning area.

[0045] Represents the area of ​​the distorted region at the first detection time point of the Z0th paper document three-dimensional scanning in the M0th paper document three-dimensional scanning area.

[0046] like Figure 2 As shown, it is a schematic diagram of a function image of the first quality risk index of the paper document restoration scan data provided by an embodiment of the present application; in the figure, the maximum value of the standard deviation of the light intensity received by the paper document is taken as the independent variable, and the first quality risk index of the paper document restoration scan data is taken as the dependent variable;

[0047] The function curve a in the figure, a=6,0.05,0.1, indicates and and Function curve a represents when and and Schematic diagram of the function graph of the first quality risk index of the paper document restoration scanning data.

[0048] The function curve b in the figure, b = 2, 0.05, 0.1, indicates and and Function curve b represents when and and Schematic diagram of the function graph of the first quality risk index of the paper document restoration scanning data.

[0049] The function curve c in the figure, c = 2, 0.05, 0.3, indicates and and Function curve c represents when and and Schematic diagram of the function graph of the first quality risk index of the paper document restoration scanning data.

[0050] It can be seen from the figure that when the maximum value of the standard deviation of the light intensity received by the paper document increases, it means that the greater the non-uniformity of the light scanning of the paper document, the greater the first quality risk index of the paper document restoration scanning data.

[0051] when and The value of is the same as When the values ​​are different, The larger the value, that is, the smaller the ratio of the three-dimensional scanned paper document image to the actual area of ​​the paper document, it means that the same paper document needs to be scanned more times, and when more document images are subsequently spliced ​​into the final three-dimensional model of the paper document, the greater the first quality risk index of the paper document restoration scanning data.

[0052] when and The value of is the same as When the values ​​are different, The larger the value, the larger the distorted area in the detected image, such as folds, wrinkles, and mildew spots, that is, the larger the ratio of the distorted area to the scanned area, indicating that the error rate of the subsequent generation of the final paper document three-dimensional model is greater, and the greater the first quality risk index of the paper document restoration scanning data.

[0053] If the maximum value of the standard deviation of the light intensity received by paper documents remains unchanged and increases, it means that at this time, the non-uniformity of the light intensity received by the paper documents is also increasing, causing the difference in the degree of overexposure or overdarkness in some areas of the paper documents to increase. The probability of blurring, unrecognizable or incorrectly identified problems in the subsequent generation of the final three-dimensional model of the paper document increases, and the first quality risk index of the paper document restoration scanning data is also greater, which is in line with the objective facts of the paper document restoration scanning situation.

[0054] Furthermore, the specific process of obtaining the second quality risk index of paper document restoration scanning data is as follows: numbering the three-dimensional scanning areas of the paper document in sequence to obtain the three-dimensional scanning area numbers of the paper document; numbering the chromatic aberration scanning detection areas in the three-dimensional scanning areas of the paper document in sequence to obtain the chromatic aberration scanning detection area numbers in the three-dimensional scanning areas of the paper document; data annotation of the paper document light intensity parameters, paper document three-dimensional scanning resolution parameters and paper document three-dimensional scanning color difference parameters according to the three-dimensional scanning area numbers of the paper document and the chromatic aberration scanning detection area numbers in the three-dimensional scanning areas of the paper document, to obtain the paper document light intensity annotation parameters, paper document three-dimensional scanning resolution annotation parameters and paper document three-dimensional scanning color difference annotation parameters; the second quality risk index of the paper document restoration scanning data is obtained by analysis.

[0055] In this embodiment, the second quality risk index of paper document restoration scan data is used to describe the negative impact level of color scanning of paper document restoration scan data for intelligent automatic restoration; the specific analysis formula is as follows:

[0056]

[0057] λ represents the second quality risk index of paper document restoration scanning data.

[0058] The chromatic aberration scanning detection areas in the three-dimensional scanning area of ​​the paper document are numbered in sequence, C0 represents the number of the chromatic aberration scanning detection area, C0=1, 2, ..., C, and C represents the total number of the chromatic aberration scanning detection areas.

[0059] It represents the maximum value of the standard deviation of the resolution of the paper document after 3D scanning in the M0th paper document 3D scanning area.

[0060] It represents the minimum value of the standard deviation of the resolution of the paper document after 3D scanning in the M0th paper document 3D scanning area.

[0061] It represents the maximum value of the standard deviation of the color difference after the three-dimensional scanning of the paper document in the M0-th three-dimensional scanning area of ​​the paper document.

[0062] It represents the minimum value of the standard deviation of the color difference after 3D scanning of the paper document in the M0th 3D scanning area of ​​the paper document.

[0063] The color difference between the color of the paper document after three-dimensional scanning and the actual color of the paper document is calculated by the CI E1976 color difference calculation formula, and several color differences of the paper document in the three-dimensional scanning area after three-dimensional scanning are obtained. The standard deviation between the several color differences is calculated, and the maximum value of the standard deviation of the color difference after three-dimensional scanning of the paper document and the minimum value of the standard deviation of the color difference after three-dimensional scanning of the paper document are obtained.

[0064] Table 1 Example of the second quality risk index of paper document restoration scanning data

[0065]

[0066] According to Table 1, when the maximum value of the standard deviation of the resolution becomes larger after the three-dimensional scanning of the paper document, it means that the resolution difference of the three-dimensional scanning of the paper document increases. The greater the resolution difference of the three-dimensional scanning of the paper document, the worse the quality of the three-dimensional scanning of the paper document. The probability of blurring, unrecognition or misrecognition of the final three-dimensional model of the paper document generated later increases. Similarly, when the maximum value of the standard deviation of the light intensity received by the paper document increases, it means that the non-uniformity of the light intensity received by the paper document is also increasing, causing some areas of the paper document to be overexposed or too dark. As the degree increases, the greater the unevenness of the illumination, the greater the negative impact on the measurement of chromatic aberration after 3D scanning of paper documents. When the maximum value of the standard deviation of chromatic aberration after 3D scanning of paper documents increases, it means that the color distortion of 3D scanning of paper documents is more serious. Due to the negative factors that may exist in paper documents, such as mold, oxidation, and folding, the resolution and uniformity of illumination in 3D scanning will have a superimposed negative impact on chromatic aberration. Combining the above evaluation factors, the evaluation and analysis of the negative impact level of color scanning of scanning data of paper document restoration by intelligent automatic restoration is more accurate and comprehensive.

[0067] Furthermore, the specific process of obtaining the third quality risk index of the paper document restoration scanning data is as follows: the third quality risk index of the paper document restoration scanning data is obtained according to the comprehensive analysis function of the first quality risk index of the paper document restoration scanning data and the second quality risk index of the paper document restoration scanning data; the specific comprehensive analysis function is as follows: η1+η2=1; ξ represents the third quality risk index of paper document restoration and scanning data, e represents a natural constant, ψ represents the first quality risk index of paper document restoration and scanning data, λ represents the second quality risk index of paper document restoration and scanning data, η1 is the first influencing factor of the third quality risk index of paper document restoration and scanning data obtained from the paper document three-dimensional scanning database, and η2 is the second influencing factor of the third quality risk index of paper document restoration and scanning data obtained from the paper document three-dimensional scanning database.

[0068] In a specific embodiment, different types of paper documents have different negative effects on the uneven illumination of three-dimensional scanning. For example, a smooth paper surface is prone to specular reflection, resulting in strong reflectivity, which affects the scanning quality; a rough paper surface scatters light and has weak reflectivity, but may produce shadows or bright spots due to uneven illumination; dark paper has strong light absorption and weak reflectivity, but may have obvious light and dark differences due to uneven illumination; paper containing impurities or special additives (such as paper used in some ancient documents) may produce different reflective effects due to uneven texture; translucent or transparent paper (such as some ancient parchment) may produce light transmittance under light, affecting the scanning effect; the surface of aged paper may become uneven, producing uneven reflection when exposed to light.

[0069] A mapping set is established through the relationship between the types of paper documents in the historical paper document restoration and scanning data and the first influencing factor of the third quality risk index of paper document restoration and scanning data and the second influencing factor of the third quality risk index of paper document restoration and scanning data. The real-time paper document types are input into the pre-set mapping set to obtain the corresponding first influencing factor of the third quality risk index of paper document restoration and scanning data and the second influencing factor of the third quality risk index of paper document restoration and scanning data.

[0070] Furthermore, the specific process of obtaining the comparative analysis results of the paper document three-dimensional scanning performance is as follows: if the third quality risk index of the paper document restoration scanning data is less than the preset paper document three-dimensional scanning performance threshold, the paper document three-dimensional scanning method is judged to be qualified and no adjustment is made.

[0071] Furthermore, the comparative analysis results of the three-dimensional scanning performance of paper documents are obtained, which also include: if the third quality risk index of the paper document restoration scanning data is not less than the preset paper document three-dimensional scanning performance threshold, then the paper document three-dimensional scanning method is judged to be unqualified; if the first quality risk index of the paper document restoration scanning data is not less than the preset first threshold of the paper document three-dimensional scanning performance or the second quality risk index of the paper document restoration scanning data is not less than the preset second threshold of the paper document three-dimensional scanning performance, then it is judged to be recorded as the first adjustment level of the paper document restoration scanning, and corresponding adjustments are made; if the first quality risk index of the paper document restoration scanning data is not less than the preset first threshold of the paper document three-dimensional scanning performance and the second quality risk index of the paper document restoration scanning data is not less than the preset second threshold of the paper document three-dimensional scanning performance, then it is judged to be recorded as the second adjustment level of the paper document restoration scanning, and corresponding adjustments are made.

[0072] In this embodiment, the preset paper document three-dimensional scanning performance threshold, the preset paper document three-dimensional scanning performance first threshold, and the preset paper document three-dimensional scanning performance second threshold are extracted from a paper document three-dimensional scanning database.

[0073] The three-dimensional scanning method of the paper document is judged to be unqualified, which is compared with the qualified judgment above. The specific adjustments need to be made as mentioned above.

[0074] Furthermore, the corresponding adjustments specifically include: if it is judged to be the first adjustment level for paper document restoration scanning, then increasing the single scanning area of ​​the three-dimensional scanning device, adjusting the exposure time of the three-dimensional scanning device, adjusting the exposure contrast of the three-dimensional scanning device, and adjusting the angle of multi-light source illumination of the three-dimensional scanning device; if it is judged to be the second adjustment level for paper document restoration scanning, then increasing the resolution accuracy of the three-dimensional scanning device and adjusting the filter type of the three-dimensional scanning device.

[0075] In this embodiment, increasing the single scanning area can cover a larger portion of the document, reducing the number of scans, thereby improving the overall scanning efficiency, and can reduce the errors generated when splicing different scan areas, thereby improving the accuracy of the subsequent three-dimensional model of the paper document.

[0076] Adjusting the exposure time helps obtain clearer images, avoid overexposure or underexposure, and ensure the visibility of details of paper documents.

[0077] Adjusting the contrast can enhance the clarity of important features in the image, making the scan more vivid and realistic.

[0078] By adjusting the lighting angles of multiple light sources, you can reduce reflection and shadow problems caused by uneven lighting and improve the uniformity of scanning results.

[0079] By improving image quality during the scanning stage, the amount of image correction and processing required later can be reduced, saving time and resources.

[0080] Improving resolution accuracy can capture more details in documents, such as tiny text, fine patterns and complex designs. This is crucial for restoration work that requires a high degree of restoration of the original state of the document.

[0081] Higher resolution means smaller pixels, which helps create clearer and sharper images, allowing restorers to more accurately identify and treat damaged parts of documents.

[0082] Higher resolution scans reduce the need for enlargement and cropping in post-processing because the raw data already contains sufficient detail.

[0083] Adjusting the filter type can filter out specific wavelengths of light, reduce interference with certain materials, and improve the scanning effect of certain types of documents, especially those that are sensitive to specific wavelengths.

[0084] The improved resolution and more accurate color reproduction allow restorers to perform more detailed restoration work, such as repairing tiny tears or stains.

[0085] High-resolution scanning data provides a better basis for the long-term preservation and display of documents, ensuring that future visitors can see the true appearance of the documents.

[0086] The above adjustment measures will help improve the quality of restoration and scanning of paper documents, making the restoration work more accurate and efficient, while also providing better support for the long-term preservation and digital display of documents.

[0087] Furthermore, the specific process of performing three-dimensional scanning of paper documents and intelligently and automatically repairing them according to the adjusted three-dimensional scanning of paper documents is as follows: the adjusted three-dimensional scanning data of paper documents obtained by scanning at multiple angles are spliced ​​through three-dimensional scanning processing software, and data noise in the adjusted three-dimensional scanning data of paper documents is removed to obtain a three-dimensional model of the paper document; a deep learning algorithm is used to extract features of the distorted area data in the three-dimensional model of the paper document, and intelligent repair is performed according to the features of the distorted area data; the three-dimensional model of the paper document after intelligent repair is transmitted and saved in a three-dimensional scanning database of paper documents.

[0088] In this embodiment, the 3D scanning processing software may be Agi soft Photoscan, which is a professional software for processing 3D scanning data and can be used for noise removal, data stitching and 3D model generation.

[0089] The distorted area data in the three-dimensional effective data of the paper document corresponds to the damaged area in the paper document, such as creases, gaps, ink fall-off, etc.

[0090] Obtaining the three-dimensional model of paper documents also specifically includes:

[0091] 1. Feature-based stitching: Feature detection, the 3D scanning processing software will automatically detect key feature points in the scan data, such as corners, edges, etc.; feature matching, matching the same feature points in different scanning perspectives to determine their relative positions in space; algorithm selection, select a feature-based stitching algorithm in the 3D scanning processing software, such as SIFT (Scale Invariant Feature Transform) or SURF (Speeded Up Robust Features).

[0092] 2. Mesh generation: the process of building a 3D model based on the spliced ​​data: point cloud merging, merging all scanned point clouds into a single point cloud data set; surface reconstruction, using algorithms (such as Poisson reconstruction or greedy triangulation) to build a 3D surface from the point cloud; mesh refinement: the generated mesh may need further refinement to ensure the accuracy of the details; mesh optimization, mesh optimization is to improve the quality of the model, including smoothing, hole repair, topology correction and detail retention.

[0093] 3. Noise removal: Noise detection, using 3D scanning processing software to detect noise and irregular points in the 3D model of paper documents; noise removal, manually selecting and removing obvious noise points in the 3D scanning processing software; automatic processing, using the automatic denoising function of the 3D scanning processing software, such as using filters, smoothing algorithms, etc., to further purify the 3D model of paper documents.

[0094] It should be noted that the process of obtaining the above three-dimensional models of paper documents is mostly an automated processing process using three-dimensional scanning processing software.

[0095] Deep learning algorithms can be used through PyTorh and other deep learning frameworks to train and deploy convolutional neural networks for image recognition and segmentation, thereby extracting features and intelligently repairing and detecting distorted areas of paper documents.

[0096] The deep learning algorithm is used to extract the features of the distorted area data in the three-dimensional model of the paper document, and intelligently repair the distorted area data according to the features. The specific examples are as follows:

[0097] 1. Choose PyTorch as the deep learning framework and convolutional neural network structure.

[0098] 2. Select mean square error as the loss function and Adam as the optimization algorithm.

[0099] 3. Set the learning rate to 0.002 and the maximum number of iterations to 128. Train the intelligent repair model through multiple iterations and adjust the parameters to minimize the loss function.

[0100] 4. Use the trained intelligent restoration model to extract the features of the distorted area, and use the intelligent restoration model to perform image recognition, segmentation and restoration on the document.

[0101] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0102] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A method that specifies the functionality of a box or multiple boxes.

[0103] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction method, which is implemented in the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0104] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0105] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0106] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for intelligent automatic repair of three-dimensional scanning of paper documents, characterized in that: The following steps are involved: Collect 3D scanning parameters of paper documents; According to the paper document three-dimensional scanning parameters, a first performance evaluation of the paper document three-dimensional scanning and a second performance evaluation of the paper document three-dimensional scanning are respectively performed to obtain a paper document three-dimensional scanning performance evaluation result; According to the comparison and analysis of the paper document 3D scanning performance evaluation results and the preset paper document 3D scanning performance threshold, the paper document 3D scanning performance comparison and analysis results are obtained; Adjust the 3D scanning of paper documents according to the comparative analysis results of the 3D scanning performance of paper documents; The specific process of collecting the three-dimensional scanning parameters of paper documents is as follows: Performing three-dimensional scanning on paper documents through three-dimensional scanning equipment to collect and obtain three-dimensional scanning parameters of paper documents; The paper document three-dimensional scanning parameters include a scanning area parameter, a paper document area parameter, a paper document illumination intensity parameter, a paper document three-dimensional scanning resolution parameter, and a paper document three-dimensional scanning color difference parameter; The specific process of obtaining the paper document three-dimensional scanning performance evaluation result is as follows: According to the evaluation and analysis of the scanning area parameter, the paper document area parameter and the paper document light intensity parameter in the paper document three-dimensional scanning parameters, the first quality risk index of the paper document restoration scanning data is obtained; According to the paper document 3D scanning parameters, including the paper document illumination intensity parameter, the paper document 3D scanning resolution parameter and the paper document 3D scanning color difference parameter, the second quality risk index of the paper document restoration scanning data is obtained; Based on the comprehensive analysis of the first quality risk index of paper document restoration scanning data and the second quality risk index of paper document restoration scanning data, the third quality risk index of paper document restoration scanning data is obtained.

2. The method for intelligent automatic repair of three-dimensional scanning of paper documents as claimed in claim 1, characterized in that: The specific process of obtaining the first quality risk index of paper document restoration scanning data is as follows: The three-dimensional scanning areas of the paper document are numbered in sequence to obtain the three-dimensional scanning area numbers of the paper document; Sequentially number the first detection time points of the three-dimensional scanning of the paper document to obtain the first detection time point number of the three-dimensional scanning of the paper document; According to the paper document 3D scanning area number and the paper document 3D scanning first detection time point number, data annotation is performed on the paper document illumination intensity parameter, the paper document 3D scanning resolution parameter and the paper document 3D scanning color difference parameter to obtain the paper document illumination intensity annotation parameter, the paper document 3D scanning resolution annotation parameter and the paper document 3D scanning color difference annotation parameter; This analysis resulted in the first quality risk index of paper document restoration scanning data.

3. The method for intelligent automatic restoration of three-dimensional scanning of paper documents as claimed in claim 1, characterized in that: The specific process of obtaining the second quality risk index of paper document restoration scanning data is as follows: The three-dimensional scanning areas of the paper document are numbered in sequence to obtain the three-dimensional scanning area numbers of the paper document; Sequentially numbering the color difference scanning detection areas in the three-dimensional scanning area of ​​the paper document to obtain the color difference scanning detection area numbers in the three-dimensional scanning area of ​​the paper document; According to the paper document 3D scanning area number and the chromatic aberration scanning detection area number in the paper document 3D scanning area, the paper document 3D scanning resolution parameter and the paper document 3D scanning chromatic aberration parameter are respectively annotated to obtain the paper document 3D scanning resolution parameter and the paper document 3D scanning chromatic aberration parameter; The second quality risk index of paper document restoration scanning data was obtained through this analysis.

4. The method for intelligent automatic repair of three-dimensional scanning of paper documents as claimed in claim 1, characterized in that: The specific process of obtaining the third quality risk index of paper document restoration scanning data is as follows: The third quality risk index of the paper document restoration scanning data is obtained according to the comprehensive analysis function of the first quality risk index of the paper document restoration scanning data and the second quality risk index of the paper document restoration scanning data; The specific comprehensive analysis function is as follows: η1+η2=1; ξ represents the third quality risk index of paper document restoration and scanning data, e represents a natural constant, ψ represents the first quality risk index of paper document restoration and scanning data, λ represents the second quality risk index of paper document restoration and scanning data, η1 is the first influencing factor of the third quality risk index of paper document restoration and scanning data obtained from the paper document three-dimensional scanning database, and η2 is the second influencing factor of the third quality risk index of paper document restoration and scanning data obtained from the paper document three-dimensional scanning database.

5. The method for intelligent automatic repair of three-dimensional scanning of paper documents as claimed in claim 1, characterized in that: The specific process of obtaining the comparative analysis results of the three-dimensional scanning performance of paper documents is as follows: If the third quality risk index of the paper document restoration scanning data is less than the preset paper document three-dimensional scanning performance threshold, the paper document three-dimensional scanning method is judged to be qualified and no adjustment is made.

6. The method for intelligent automatic repair of three-dimensional scanning of paper documents as claimed in claim 1, characterized in that: The obtaining of the comparative analysis results of the three-dimensional scanning performance of paper documents also includes: If the third quality risk index of the paper document restoration scanning data is not less than the preset paper document three-dimensional scanning performance threshold, the paper document three-dimensional scanning method is judged to be unqualified; If the first quality risk index of the paper document restoration scanning data is not less than the preset first threshold of the paper document three-dimensional scanning performance, it is judged as the first adjustment level of the paper document restoration scanning, and corresponding adjustments are made; If the second quality risk index of the paper document restoration scanning data is not less than the preset second threshold of the paper document three-dimensional scanning performance, it is judged as the second adjustment level of the paper document restoration scanning and corresponding adjustments are made.

7. The method for intelligent automatic restoration of three-dimensional scanning of paper documents as claimed in claim 6, characterized in that: The corresponding adjustments specifically include: If it is determined to be the first adjustment level for paper document restoration scanning, the single scanning area of ​​the three-dimensional scanning device is increased, the exposure time of the three-dimensional scanning device is adjusted, the exposure contrast of the three-dimensional scanning device is adjusted, and the angle of multi-light source illumination of the three-dimensional scanning device is adjusted.

8. The method for intelligent automatic repair of three-dimensional scanning of paper documents as claimed in claim 7, characterized in that: The corresponding adjustment also includes: If it is determined to be the second adjustment level for paper document restoration scanning, the resolution accuracy of the three-dimensional scanning device is improved and the filter type of the three-dimensional scanning device is adjusted.

Images