Image correction method and system based on pattern recognition

Abstract

The invention discloses an image correction method and an image correction system based on pattern recognition, which are suitable for the operation assistance of image restoration on the surface of a damaged object, particularly used in the fields of cultural relic investigation and the like, and can be used for correcting the surface of the damaged object by scanning a damaged and lost object structure and an image, establishing a twin digital object and recognizing and judging the twin digital object. The method comprises the following steps: determining a missing area range of a surface image and an image category and image content of an image in a complete area, retrieving and matching contents according to the category, associating the contents with edge contents of the missing area, selecting highly matched contents to supplement and correct the missing contents, and sequentially providing operation assistance for repairing personnel, so that the repairing efficiency is improved. And efficient content possibility screening is conveniently realized, and the correction operation efficiency is optimized.

Description

Technical Field

[0001] The present invention relates to the field related to graphic recognition and correction, and in particular to an image correction method and system based on graphic recognition. Background Art

[0002] In the process of investigating and restoring cultural relics, cultural relics may be damaged or missing due to various historical reasons, resulting in the structure of the cultural relics being incomplete. Relevant professionals are needed to restore them. The main difficulty in restoration lies in the restoration of surface content, especially for cultural relics with images, texts, etc. During the restoration process, it is necessary to judge the possibility and rationality of the original content based on the remaining content in order to restore it.

[0003] In the prior art, due to the importance of the cultural relics, manual repair is usually adopted. Professionals repair the damaged contents during the process of repairing the cultural relics structure, but it is limited to the partially damaged contents. In addition, when the cultural relics are seriously broken, the entire splicing and restoration process is more cumbersome and lengthy, and consumes a lot of energy. At the same time, the damage may be further increased due to repeated movement of cultural relic fragments during the restoration attempt. Summary of the invention

[0004] The object of the present invention is to provide an image correction method and system based on pattern recognition to solve the problems raised in the above background technology.

[0005] To achieve the above object, the present invention provides the following technical solutions: An image correction method based on graphic recognition, comprising: Synchronize the data acquisition end to obtain sensor scanning data, perform object restoration modeling based on multiple sets of sensor scanning data, and obtain a twin digital object including a coverage map layer, wherein the sensor scanning data includes radar point cloud data and surface image data; Performing image layer judgment based on the twin digital object to identify and mark the image missing area on the surface of the object, and performing planarization processing on the image data of the non-missing area to generate image data accordingly, wherein the image data includes the image missing area mark; Retrieve the image category and image content according to the image data, and perform feature matching and content matching in sequence based on the edge content of the image missing area to obtain a corrected image corresponding to the image missing area, wherein the number of corrected images corresponding to each image missing area is one or more; The plurality of corrected images are sorted in descending order based on the matching rates of feature matching and content matching, and an interactive queue of image missing areas is generated based on the sorting results to output the image data accordingly.

[0006] As a further solution of the present invention: the step of retrieving the image category and image content according to the image data, and sequentially performing feature matching and content matching based on the edge content of the image missing area to obtain a corrected image corresponding to the image missing area specifically includes: Extracting features of the image in the image data, identifying and determining text features and graphic features in the image, and respectively retrieving and obtaining feature types corresponding to the text features and graphic features, wherein the feature types are used to characterize the style categories of the text and the image; If there is a cropped image object at the edge of the missing area of ​​the image, the cropped image is obtained, feature matching is performed based on a feature database of feature types corresponding to text features and graphic features, and multiple matching image objects are selected in sequence based on the matching rate as the corrected image, where the image objects are used to represent content elements under the feature type, including text and basic graphics; After the cropped image is matched, the content elements and meaning composition of the image data are understood, and the associated text content and graphic elements are matched, and a corrected image is generated based on the text content and graphic elements.

[0007] As a further solution of the present invention: the step of performing image layer judgment based on the twin digital object to identify and mark the image missing area on the object surface specifically includes: Performing color continuity evaluation on the object surface of the twin digital object, generating an evaluation point grid with equal spacing distribution with a preset evaluation accuracy, and calculating the color span value between the evaluation points, wherein the color span value is used to represent the interval value between two color corresponding points on the same evaluation palette; If the color span value reaches the preset evaluation standard, a range is marked on a continuous area on the surface of the object based on the color value of the evaluation point to generate an abnormal area to be screened; A structural evaluation is performed on the surface of the object in the abnormal area to be screened. If the object structure in the abnormal area to be screened is manifested as regional subsidence or abnormal surface brightness, the abnormal area to be screened is an image missing area. The regional subsidence is used to characterize the missing and damaged object structure, and the abnormal surface brightness is used to characterize the weathering and corrosion of the object surface structure.

[0008] As a further solution of the present invention, it also includes an auxiliary step of restoring the fragmented object, specifically including: When the object structure is characterized as a region sinking, a gap space model of the sinking region is obtained, and the surface side of the object is marked; Obtaining fragment space models of multiple fragment objects, performing accommodation evaluation on the fragment space model based on the gap space model, judging whether the sinking gap can accommodate the fragment space model, establishing an accommodation list based on the judgment result, and arranging the surface side of the fragment object and the sinking gap to overlap when performing the accommodation evaluation; A cross-matching verification is performed on several corrected images based on the object surface image content of the fragment objects in the accommodation list to screen the double-matched corrected images.

[0009] As a further solution of the present invention: the step of planarizing the image data of the non-deleted area specifically includes: Establish a surface mesh, divide the corresponding surface of the object surface into several triangular meshes, and perform surface discretization processing; Performing a planar projection on each of the triangular meshes in the three-dimensional surface to obtain an initial unfolded graph, and gradually unfolding the adjacent triangular meshes to maintain the adjacent relationship of the meshes; An objective function is defined to generate a conversion objective function for maintaining the side length and angle of the triangular mesh, and the initial unfolded graph is optimized for scaling based on the objective function.

[0010] The embodiment of the present invention aims to provide an image correction system based on graphic recognition, comprising: An object restoration module is used to synchronize with the data acquisition end to obtain sensor scanning data, perform object restoration modeling based on multiple sets of sensor scanning data, and obtain a twin digital object including a coverage map layer, wherein the sensor scanning data includes radar point cloud data and surface image data; A missing location module is used to perform image layer judgment based on the twin digital object to identify and mark the image missing area on the surface of the object, and to perform planarization processing on the image data of the non-missing area to generate image data accordingly, wherein the image data includes the image missing area mark; A content retrieval module, used to retrieve the image category and image content according to the image data, and perform feature matching and content matching in sequence based on the edge content of the image missing area to obtain a corrected image corresponding to the image missing area, wherein the number of corrected images corresponding to each image missing area is one or more; The correction feedback module is used to sort the multiple corrected images in descending order based on the matching rates of feature matching and content matching, and to generate an interactive queue of image missing areas based on the sorting results to output the image data accordingly.

[0011] As a further solution of the present invention: the content retrieval module includes: A feature resolution unit is used to extract features from the image in the image data, identify and judge the text features and graphic features in the image, and retrieve and obtain feature types corresponding to the text features and graphic features, respectively, wherein the feature types are used to characterize the style categories of the text and the image; A cropping correction unit, configured to obtain the cropped image if there is a cropped image object at the edge of the missing area of ​​the image, perform feature matching based on a feature database of feature types corresponding to text features and graphic features, and select multiple matching image objects in sequence as correction images based on a matching rate, wherein the image objects are used to represent content elements under the feature type, including text and basic graphics; The correction verification unit is used to understand the content elements and meaning composition of the image data after the cropped image is matched, and to match the associated text content and graphic elements, and to generate a corrected image based on the text content and graphic elements.

[0012] As a further solution of the present invention: the missing location module includes: Performing color continuity evaluation on the object surface of the twin digital object, generating an evaluation point grid with equal spacing distribution with a preset evaluation accuracy, and calculating the color span value between the evaluation points, wherein the color span value is used to represent the interval value between two color corresponding points on the same evaluation palette; If the color span value reaches the preset evaluation standard, a range is marked on a continuous area on the surface of the object based on the color value of the evaluation point to generate an abnormal area to be screened; A structural evaluation is performed on the surface of the object in the abnormal area to be screened. If the object structure in the abnormal area to be screened is manifested as regional subsidence or abnormal surface brightness, the abnormal area to be screened is an image missing area. The regional subsidence is used to characterize the missing and damaged object structure, and the abnormal surface brightness is used to characterize the weathering and corrosion of the object surface structure.

[0013] As a further solution of the present invention: it also includes a fragment reset module, specifically including: A sinking marking unit, used for obtaining a gap space model of the sinking area and marking the surface side of the object when the object structure is characterized as a sinking area; an accommodation judgment unit, for obtaining a fragmentation space model of a plurality of fragmentation objects, performing accommodation evaluation on the fragmentation space model based on the gap space model, judging whether the sinking gap can accommodate the fragmentation space model, establishing an accommodation list based on the judgment result, and when performing the accommodation evaluation, arranging the surface side of the fragmentation object and the sinking gap to overlap; The cross-matching unit is used to perform cross-matching verification on a plurality of corrected images based on the object surface image content of the fragment objects in the accommodation list to screen out double-matched corrected images.

[0014] As a further solution of the present invention: the missing location module also includes: A meshing unit is used to establish a surface mesh, divide the corresponding surface of the object surface into several triangular meshes, and perform surface discretization processing; A projection processing unit, used for performing a planar projection on each of the triangular meshes in the three-dimensional surface to obtain an initial unfolded graph, and the adjacent triangular meshes are gradually unfolded to maintain the adjacent relationship of the meshes; The scaling optimization unit is used to define an objective function to generate a conversion objective function for maintaining the side length and angle of the triangular mesh, and to perform scaling optimization on the initial unfolded graphic based on the objective function.

[0015] Compared with the prior art, the beneficial effects of the present invention are: it is suitable for auxiliary work in repairing the surface image of damaged objects, especially for use in fields such as cultural relics investigation, by scanning the structure and image of damaged and missing objects, establishing a twin digital object, identifying and judging the twin digital object, determining the area range of missing surface images and the image category and image content of the image in the complete area, and retrieving and matching content according to the category, associating it with the edge content of the missing area, selecting highly matched content to supplement and correct the missing content, and providing operational assistance to repair personnel in turn, facilitating efficient content possibility screening, and optimizing the efficiency of correction work. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 The figure is a flowchart of an image correction method based on graphic recognition.

[0017] Figure 2 The figure is a flowchart of the auxiliary restoration step in an image correction method based on pattern recognition.

[0018] Figure 3 The figure is a block diagram of an image correction system based on graphic recognition. DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0020] The specific implementation of the present invention is described in detail below in conjunction with specific embodiments.

[0021] like Figure 1 The image correction method based on graphic recognition provided by an embodiment of the present invention comprises the following steps: S10, synchronizing the data acquisition end to obtain sensor scanning data, performing object restoration modeling based on multiple sets of sensor scanning data, and obtaining a twin digital object including a coverage map layer, wherein the sensor scanning data includes radar point cloud data and surface image data; S20, performing image layer judgment based on the twin digital object to identify and mark the image missing area on the surface of the object, and performing planarization processing on the image data of the non-missing area to generate image data accordingly, wherein the image data includes the image missing area mark; S30, searching for image category and image content according to the image data, and performing feature matching and content matching in sequence based on edge content of the image missing area to obtain a corrected image corresponding to the image missing area, wherein the number of corrected images corresponding to each image missing area is one or more; S40, sorting the plurality of corrected images in descending order based on the matching rates of feature matching and content matching, and generating an interactive queue of image missing areas based on the sorting results to output the image data accordingly.

[0022] In this embodiment, a method for image correction based on graphic recognition is provided, which is suitable for assisting the repair of the surface image of damaged objects, especially for the field of cultural relics investigation, etc., by scanning the structure and image of the damaged and missing object, establishing a twin digital object, identifying and judging the twin digital object, determining the area range of the missing surface image and the image category and image content of the image in the complete area, and retrieving and matching the content according to the category, associating it with the edge content of the missing area, selecting the highly matched content to supplement and correct the missing content, and providing operation assistance to the repair personnel in turn, facilitating efficient content possibility screening, and optimizing the efficiency of the correction operation; in the process of cultural relics investigation and restoration, cultural relics may be damaged or missing due to various historical reasons, so that the structure of the cultural relics is no longer complete, and relevant professionals are required to restore them. The main difficulty of restoration lies in the restoration of surface content, especially for cultural relics with images, texts and other contents. In the restoration process, it is necessary to judge the possibility and rationality of the original content based on the remaining content for restoration. The auxiliary implementation process adopted here is: first, the data acquisition end obtains the sensor scanning data for object restoration modeling, including radar point cloud data and image data, to respectively realize structural modeling and surface mapping coverage. After obtaining the twin digital object, the missing area of ​​the surface layer of the twin digital object is determined, which usually includes two parts, one is caused by structural loss, and the other is caused by surface corrosion; the edge of the missing area and the content of the complete area can be retrieved from the database through graphic recognition to determine the dynasty, format, specific use and meaning, and common components of the text and content in the image, so that the matching range can be further narrowed. At this time, the partial incomplete content at the edge of the missing area can be matched, and the content with matching features can be selected as the correction content. For the completely correct part, the possibility can be evaluated by content recognition. For example, when it is text content, the possibility is matched according to the expression relevance of the complete part content and the common expression method under the current content format, and multiple groups of suitable content are selected as the correction standby content to assist relevant personnel in repair.

[0023] As another preferred embodiment of the present invention, the step of retrieving the image category and image content according to the image data, and sequentially performing feature matching and content matching based on the edge content of the image missing area to obtain a corrected image corresponding to the image missing area specifically includes: Extracting features of the image in the image data, identifying and determining text features and graphic features in the image, and respectively retrieving and obtaining feature types corresponding to the text features and graphic features, wherein the feature types are used to characterize the style categories of the text and the image; If there is a cropped image object at the edge of the missing area of ​​the image, the cropped image is obtained, feature matching is performed based on a feature database of feature types corresponding to text features and graphic features, and multiple matching image objects are selected in sequence based on the matching rate as the corrected image, where the image objects are used to represent content elements under the feature type, including text and basic graphics; After the cropped image is matched, the content elements and meaning composition of the image data are understood, and the associated text content and graphic elements are matched, and a corrected image is generated based on the text content and graphic elements.

[0024] In this embodiment, the process of feature matching and content matching is further explained. The feature type here is the content format expressed in the aforementioned embodiment, which depends on many factors such as the different production era background, usage purpose and the specific type of the object. A corresponding data matching library can be established based on historical archaeological records and related historical materials. After matching the appropriate content according to the features, in scenarios with a lot of missing content, there may be multiple matching structures. Therefore, it is necessary to further screen through the content elements and meaning composition understanding of the image data, such as whether the meaning expressed by the text combination is consistent with the overall content atmosphere.

[0025] As another preferred embodiment of the present invention, the step of performing image layer judgment based on the twin digital object to identify and mark the image missing area on the object surface specifically includes: Performing color continuity evaluation on the object surface of the twin digital object, generating an evaluation point grid with equal spacing distribution with a preset evaluation accuracy, and calculating the color span value between the evaluation points, wherein the color span value is used to represent the interval value between two color corresponding points on the same evaluation palette; If the color span value reaches the preset evaluation standard, a range is marked on a continuous area on the surface of the object based on the color value of the evaluation point to generate an abnormal area to be screened; A structural evaluation is performed on the surface of the object in the abnormal area to be screened. If the object structure in the abnormal area to be screened is manifested as regional subsidence or abnormal surface brightness, the abnormal area to be screened is an image missing area. The regional subsidence is used to characterize the missing and damaged object structure, and the abnormal surface brightness is used to characterize the weathering and corrosion of the object surface structure.

[0026] In this embodiment, the steps for determining the missing area of ​​the image are explained, which include two aspects: color continuity judgment and structural judgment. Multiple area ranges can be determined based on the step-by-step changes in color, but the area range may be a conventional color content expression area, so it is necessary to make a judgment based on the actual state of the object. The main causes of image loss include structural damage and surface weathering and corrosion. Therefore, for the former, it is possible to determine that the area of ​​the object has sunk compared to the surrounding area (such as grooves caused by porcelain chipping, and a gap caused by breakage), and for the latter, it is common on objects that are easily corroded and damaged, such as paper, bamboo slips, etc., which will become rough and cause surface content loss due to liquid immersion.

[0027] like Figure 2 As shown, as another preferred embodiment of the present invention, it also includes an auxiliary step of restoring the fragmented object, specifically including: S51, when the object structure is characterized as a region sinking, obtaining a gap space model of the sinking region, and marking the surface side of the object; S52, obtaining a fragment space model of a plurality of fragment objects, performing accommodation evaluation on the fragment space model based on the gap space model, judging whether the sinking gap can accommodate the fragment space model, establishing an accommodation list based on the judgment result, and when performing the accommodation evaluation, arranging the fragment object to overlap with the object surface side of the sinking gap; S53, performing cross-matching verification on a plurality of corrected images based on the object surface image contents of the fragment objects in the accommodation list to screen out double-matched corrected images.

[0028] In this embodiment, the restoration assistance of fragmented objects is used when there are many smaller fragment objects. By analyzing the size and depth shape of the gap in the sunken area of ​​the more complete object, the smaller fragment object is embedded and simulated to determine whether it may be a part of the missing content in the gap. If it can be accommodated in terms of structure and volume, its surface content features are further cross-matched and verified with the aforementioned matched corrected image, thereby realizing two-way verification and screening of the fragment objects and matching content.

[0029] As another preferred embodiment of the present invention, the step of performing planarization processing on the image data of the non-missing area specifically includes: Establish a surface mesh, divide the corresponding surface of the object surface into several triangular meshes, and perform surface discretization processing; Performing a planar projection on each of the triangular meshes in the three-dimensional surface to obtain an initial unfolded graph, and gradually unfolding the adjacent triangular meshes to maintain the adjacent relationship of the meshes; An objective function is defined to generate a conversion objective function for maintaining the side length and angle of the triangular mesh, and the initial unfolded graph is optimized for scaling based on the objective function.

[0030] In this embodiment, before performing the corrected image matching, the content image of the object surface needs to be planarized, because the text image content covered on the curved surface is different from the flat content and there will be a certain degree of stretching and alienation. If it is directly retrieved based on its graphic features, it will be inaccurate. Therefore, it is necessary to use the objective function to optimize the image structure by discretizing the surface features.

[0031] like Figure 3 As shown, the present invention also provides an image correction system based on graphic recognition, which comprises: The object restoration module 100 is used to synchronize with the data acquisition end to obtain sensor scanning data, perform object restoration modeling based on multiple sets of sensor scanning data, and obtain a twin digital object including a coverage map layer, wherein the sensor scanning data includes radar point cloud data and surface image data; A missing location module 200 is used to perform image layer judgment based on the twin digital object to identify and mark the image missing area on the surface of the object, and to perform planarization processing on the image data of the non-missing area to generate image data accordingly, wherein the image data includes the image missing area mark; A content retrieval module 300 is used to retrieve the image category and image content according to the image data, and perform feature matching and content matching in sequence based on the edge content of the image missing area to obtain a corrected image corresponding to the image missing area, and the number of corrected images corresponding to each image missing area is one or more; The correction feedback module 400 is used to sort the multiple corrected images in descending order based on the matching rates of feature matching and content matching, and generate an interactive queue of image missing areas based on the sorting results to output the image data accordingly.

[0032] As another preferred embodiment of the present invention, the content retrieval module includes: A feature resolution unit is used to extract features from the image in the image data, identify and judge the text features and graphic features in the image, and retrieve and obtain feature types corresponding to the text features and graphic features, respectively, wherein the feature types are used to characterize the style categories of the text and the image; A cropping correction unit, configured to obtain the cropped image if there is a cropped image object at the edge of the missing area of ​​the image, perform feature matching based on a feature database of feature types corresponding to text features and graphic features, and select multiple matching image objects in sequence as correction images based on a matching rate, wherein the image objects are used to represent content elements under the feature type, including text and basic graphics; The correction verification unit is used to understand the content elements and meaning composition of the image data after the cropped image is matched, and to match the associated text content and graphic elements, and to generate a corrected image based on the text content and graphic elements.

[0033] As another preferred embodiment of the present invention, the missing location module includes: Performing color continuity evaluation on the object surface of the twin digital object, generating an evaluation point grid with equal spacing distribution with a preset evaluation accuracy, and calculating the color span value between the evaluation points, wherein the color span value is used to represent the interval value between two color corresponding points on the same evaluation palette; If the color span value reaches the preset evaluation standard, a range is marked on a continuous area on the surface of the object based on the color value of the evaluation point to generate an abnormal area to be screened; A structural evaluation is performed on the surface of the object in the abnormal area to be screened. If the object structure in the abnormal area to be screened is manifested as regional subsidence or abnormal surface brightness, the abnormal area to be screened is an image missing area. The regional subsidence is used to characterize the missing and damaged object structure, and the abnormal surface brightness is used to characterize the weathering and corrosion of the object surface structure.

[0034] As another preferred embodiment of the present invention, it also includes a fragment reset module, specifically including: A sinking marking unit, used for obtaining a gap space model of the sinking area and marking the surface side of the object when the object structure is characterized as a sinking area; an accommodation judgment unit, for obtaining a fragmentation space model of a plurality of fragmentation objects, performing accommodation evaluation on the fragmentation space model based on the gap space model, judging whether the sinking gap can accommodate the fragmentation space model, establishing an accommodation list based on the judgment result, and when performing the accommodation evaluation, arranging the surface side of the fragmentation object and the sinking gap to overlap; The cross-matching unit is used to perform cross-matching verification on a plurality of corrected images based on the object surface image content of the fragment objects in the accommodation list to screen out double-matched corrected images.

[0035] As another preferred embodiment of the present invention, the missing location module further includes: A meshing unit is used to establish a surface mesh, divide the corresponding surface of the object surface into several triangular meshes, and perform surface discretization processing; A projection processing unit, used for performing a planar projection on each of the triangular meshes in the three-dimensional surface to obtain an initial unfolded graph, and the adjacent triangular meshes are gradually unfolded to maintain the adjacent relationship of the meshes; The scaling optimization unit is used to define an objective function to generate a conversion objective function for maintaining the side length and angle of the triangular mesh, and to perform scaling optimization on the initial unfolded graphic based on the objective function.

[0036] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0037] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the disclosure in the specification and examples. This application is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

[0038] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An image correction method based on pattern recognition, characterized in that: Include: Synchronize the data acquisition end to obtain sensor scanning data, perform object restoration modeling based on multiple sets of sensor scanning data, and obtain a twin digital object including a coverage map layer, wherein the sensor scanning data includes radar point cloud data and surface image data; Performing image layer judgment based on the twin digital object to identify and mark the image missing area on the surface of the object, and performing planarization processing on the image data of the non-missing area to generate image data accordingly, wherein the image data includes the image missing area mark; Retrieve the image category and image content according to the image data, and perform feature matching and content matching in sequence based on the edge content of the image missing area to obtain a corrected image corresponding to the image missing area, wherein the number of corrected images corresponding to each image missing area is one or more; The plurality of corrected images are sorted in descending order based on the matching rates of feature matching and content matching, and an interactive queue of image missing areas is generated based on the sorting results to output the image data accordingly.

2. The image correction method based on pattern recognition according to claim 1, characterized in that: The step of retrieving the image category and image content according to the image data, and sequentially performing feature matching and content matching based on the edge content of the image missing area to obtain a corrected image corresponding to the image missing area specifically includes: Extracting features of the image in the image data, identifying and determining text features and graphic features in the image, and respectively retrieving and obtaining feature types corresponding to the text features and graphic features, wherein the feature types are used to characterize the style categories of the text and the image; If there is a cropped image object at the edge of the missing area of ​​the image, the cropped image is obtained, feature matching is performed based on a feature database of feature types corresponding to text features and graphic features, and multiple matching image objects are selected in sequence based on the matching rate as the corrected image, where the image objects are used to represent content elements under the feature type, including text and basic graphics; After the cropped image is matched, the content elements and meaning composition of the image data are understood, and the associated text content and graphic elements are matched, and a corrected image is generated based on the text content and graphic elements.

3. The image correction method based on pattern recognition according to claim 2, characterized in that: The step of performing image layer judgment based on the twin digital object to identify and mark the image missing area on the object surface specifically includes: Performing color continuity evaluation on the object surface of the twin digital object, generating an evaluation point grid with equal spacing distribution with a preset evaluation accuracy, and calculating the color span value between the evaluation points, wherein the color span value is used to represent the interval value between two color corresponding points on the same evaluation palette; If the color span value reaches the preset evaluation standard, a range is marked on a continuous area on the surface of the object based on the color value of the evaluation point to generate an abnormal area to be screened; A structural evaluation is performed on the surface of the object in the abnormal area to be screened. If the object structure in the abnormal area to be screened is manifested as regional subsidence or abnormal surface brightness, the abnormal area to be screened is an image missing area. The regional subsidence is used to characterize the missing and damaged object structure, and the abnormal surface brightness is used to characterize the weathering and corrosion of the object surface structure.

4. The image correction method based on pattern recognition according to claim 3, characterized in that: It also includes auxiliary steps for restoring fragmented objects, including: When the object structure is characterized as a region sinking, a gap space model of the sinking region is obtained, and the surface side of the object is marked; Obtaining fragment space models of multiple fragment objects, performing accommodation evaluation on the fragment space model based on the gap space model, judging whether the sinking gap can accommodate the fragment space model, establishing an accommodation list based on the judgment result, and arranging the surface side of the fragment object and the sinking gap to overlap when performing the accommodation evaluation; A cross-matching verification is performed on several corrected images based on the object surface image content of the fragment objects in the accommodation list to screen the double-matched corrected images.

5. The image correction method based on pattern recognition according to claim 1, characterized in that: The step of performing planarization processing on the image data of the non-missing area specifically includes: Establish a surface mesh, divide the corresponding surface of the object surface into several triangular meshes, and perform surface discretization processing; Performing a planar projection on each of the triangular meshes in the three-dimensional surface to obtain an initial unfolded graph, and gradually unfolding the adjacent triangular meshes to maintain the adjacent relationship of the meshes; An objective function is defined to generate a conversion objective function for maintaining the side length and angle of the triangular mesh, and the initial unfolded graph is optimized for scaling based on the objective function.

6. An image correction system based on pattern recognition, characterized in that: Include: An object restoration module is used to synchronize with the data acquisition end to obtain sensor scanning data, perform object restoration modeling based on multiple sets of sensor scanning data, and obtain a twin digital object including a coverage map layer, wherein the sensor scanning data includes radar point cloud data and surface image data; A missing location module is used to perform image layer judgment based on the twin digital object to identify and mark the image missing area on the surface of the object, and to perform planarization processing on the image data of the non-missing area to generate image data accordingly, wherein the image data includes the image missing area mark; A content retrieval module, used to retrieve the image category and image content according to the image data, and perform feature matching and content matching in sequence based on the edge content of the image missing area to obtain a corrected image corresponding to the image missing area, wherein the number of corrected images corresponding to each image missing area is one or more; The correction feedback module is used to sort the multiple corrected images in descending order based on the matching rates of feature matching and content matching, and to generate an interactive queue of image missing areas based on the sorting results to output the image data accordingly.

7. The image correction system based on pattern recognition according to claim 6, characterized in that: The content retrieval module comprises: A feature resolution unit is used to extract features from the image in the image data, identify and judge the text features and graphic features in the image, and retrieve and obtain feature types corresponding to the text features and graphic features, respectively, wherein the feature types are used to characterize the style categories of the text and the image; A cropping correction unit, configured to obtain the cropped image if there is a cropped image object at the edge of the missing area of ​​the image, perform feature matching based on a feature database of feature types corresponding to text features and graphic features, and select multiple matching image objects in sequence as correction images based on a matching rate, wherein the image objects are used to represent content elements under the feature type, including text and basic graphics; The correction verification unit is used to understand the content elements and meaning composition of the image data after the cropped image is matched, and to match the associated text content and graphic elements, and to generate a corrected image based on the text content and graphic elements.

8. The image correction system based on pattern recognition according to claim 7, characterized in that: The missing location module comprises: Performing color continuity evaluation on the object surface of the twin digital object, generating an evaluation point grid with equal spacing distribution with a preset evaluation accuracy, and calculating the color span value between the evaluation points, wherein the color span value is used to represent the interval value between two color corresponding points on the same evaluation palette; If the color span value reaches the preset evaluation standard, a range is marked on a continuous area on the surface of the object based on the color value of the evaluation point to generate an abnormal area to be screened; A structural evaluation is performed on the surface of the object in the abnormal area to be screened. If the object structure in the abnormal area to be screened is manifested as regional subsidence or abnormal surface brightness, the abnormal area to be screened is an image missing area. The regional subsidence is used to characterize the missing and damaged object structure, and the abnormal surface brightness is used to characterize the weathering and corrosion of the object surface structure.

9. The image correction system based on pattern recognition according to claim 8, characterized in that: It also includes a fragment reset module, specifically including: A sinking marking unit, used for obtaining a gap space model of the sinking area and marking the surface side of the object when the object structure is characterized as a sinking area; an accommodation judgment unit, for obtaining a fragmentation space model of a plurality of fragmentation objects, performing accommodation evaluation on the fragmentation space model based on the gap space model, judging whether the sinking gap can accommodate the fragmentation space model, establishing an accommodation list based on the judgment result, and when performing the accommodation evaluation, arranging the surface side of the fragmentation object and the sinking gap to overlap; The cross-matching unit is used to perform cross-matching verification on a plurality of corrected images based on the object surface image content of the fragment objects in the accommodation list to screen out double-matched corrected images.

10. The image correction system based on pattern recognition according to claim 6, characterized in that: The missing location module also includes: A meshing unit is used to establish a surface mesh, divide the corresponding surface of the object surface into several triangular meshes, and perform surface discretization processing; A projection processing unit, used for performing a planar projection on each of the triangular meshes in the three-dimensional surface to obtain an initial unfolded graph, and the adjacent triangular meshes are gradually unfolded to maintain the adjacent relationship of the meshes; The scaling optimization unit is used to define an objective function to generate a conversion objective function for maintaining the side length and angle of the triangular mesh, and to perform scaling optimization on the initial unfolded graphic based on the objective function.

Images