Electronic file long-term storage method and system based on metadata template analysis

Abstract

The invention relates to an electronic archive long-term storage method and system based on metadata template analysis, which are applied to the technical field of electronic archive management, and the method comprises the following steps: obtaining a to-be-stored electronic archive and archive basic information of the to-be-stored electronic archive; generating a metadata file based on a preset metadata template, the to-be-stored electronic archive and the archive basic information, and storing the metadata file; determining an archive storage position of the to-be-stored electronic archive based on the archive basic information; obtaining an archive data verification rule; verifying the metadata file and the to-be-stored electronic archive based on the archive data verification rule to generate a verification result; and storing the to-be-stored electronic archive based on the archive storage position, the verification result and the metadata file. The method has the technical effect of efficiently and orderly storing the electronic archives for a long time.

Description

Technical Field

[0001] The present application relates to the technical field of electronic archive management, and in particular to a method and system for long-term preservation of electronic archives based on metadata template parsing. Background Art

[0002] Electronic archives are electronic files that have evidence, reference and preservation value and are archived. In the current digital information age, the number of electronic archives is growing explosively, and their long-term preservation faces many challenges. Traditional archive preservation methods are difficult to adapt to the characteristics of electronic archives, such as data volatility, format diversity and storage media complexity.

[0003] Therefore, in the process of electronic archive management, how to ensure the authenticity, integrity, availability and security of the archives is the key to electronic archive management. Summary of the invention

[0004] In order to preserve electronic archives efficiently and orderly for a long time, the present application provides a method and system for long-term preservation of electronic archives based on metadata template parsing.

[0005] In the first aspect, the present application provides a method for long-term preservation of electronic archives based on metadata template parsing, which adopts the following technical solutions: A method for long-term preservation of electronic archives based on metadata template analysis, comprising: Acquire the electronic archive to be stored and the basic archive information of the electronic archive to be stored; Generate and store a metadata file based on a preset metadata template, the electronic archive to be stored and the basic information of the archive; Determine the archive storage location of the electronic archive to be stored based on the archive basic information; Get the archival data validation rules; Verifying the metadata file and the electronic archive to be stored based on the archive data verification rule, and generating a verification result; The electronic archive to be stored is stored and preserved based on the archive storage location, the verification result and the metadata file.

[0006] By adopting the above technical solution, the electronic archives to be stored are parsed and integrated using the preset metadata template and the basic information of the archives, and a metadata file is generated. The metadata file carrying the information of the electronic archives to be stored is stored, so that when there is a problem with the electronic archives to be stored, the metadata file can be used to rescue the electronic archives to be stored. At the same time, the archive storage location most suitable for the electronic archives to be stored is determined according to the basic information of the archives, and the metadata file and the electronic archives to be stored are verified according to the archive data verification rules. The electronic archives to be stored are stored and preserved through the verification results and metadata files finally generated, so that the electronic archives to be stored are stored in the most suitable location, and the metadata files are used for safe processing, which can reduce the possibility of accidental damage and irrecoverable damage to the electronic archives to be stored, thereby realizing the demand for efficient and orderly long-term preservation of electronic archives.

[0007] Optionally, the step of generating and storing a metadata file based on a preset metadata template, the electronic archive to be stored and the archive basic information includes: Determine the archive file type of the electronic archive to be stored based on the archive basic information; Selecting the preset metadata template based on the archive file type to determine a target parsing template; Performing metadata content analysis on the electronic archive to be stored based on the target analysis template to generate a metadata file; Performing structured data processing on the metadata file to generate a structured metadata file; Get the file storage rules of the metadata file; The structured metadata file is stored in a preset storage database based on the file storage rule.

[0008] Optionally, determining the archive storage location of the electronic archive to be stored based on the archive basic information includes: Determine the archive access data and archive size of the electronic archive to be stored based on the archive basic information; Get system storage resource information; Determining an estimated storage location of the electronic archive to be stored based on the archive access data and the system storage resource information; Determining whether the estimated storage location can store the electronic file to be stored based on the file size and the system storage resource information; If the estimated storage location can store the electronic file to be stored, the estimated storage location is used as the file storage location; If the estimated storage location cannot store the electronic file to be stored, obtaining the retention period of the electronic file to be stored; The estimated storage location is adjusted based on the retention period and the archive size to generate an archive storage location.

[0009] Optionally, after storing and saving the electronic archive to be stored based on the archive storage location, the verification result and the metadata file, the method further includes: Performing automatic inspection on the storage status of the electronic archive to be stored in real time and generating automatic inspection information; Determining whether the electronic file to be stored is safe based on the automatic inspection information; If the electronic file to be stored is safe, repeating the step of automatically inspecting the storage status of the electronic file to be stored in real time; If the electronic file to be stored is not safe, determining the storage abnormality type of the electronic file to be stored based on the automatic inspection information; Determine an abnormal solution for the electronic archive to be stored based on the storage abnormality type; An archive inspection report is generated based on the automatic inspection information, the storage exception type and the exception solution.

[0010] Optionally, the method further includes: In response to a user's electronic archive query operation, obtaining query content input by the user; Standardizing the query content to generate keywords to be queried; Get query conversion rules; Converting the query content into a query statement based on the query conversion rule and the keywords to be queried; Performing content query based on the query statement and the metadata file to generate query results; Determine whether the query result is empty; If the query result is not empty, determining the target electronic file based on the query result; Feeding back the target electronic file to the query terminal of the user; If the query result is empty, then performing a content query based on the query statement and the electronic archive to be stored to determine the target electronic archive; The target electronic file is fed back to the query end of the user.

[0011] Optionally, the method further includes: Obtaining archive backup information and information arrangement rules for backup electronic archives; Generate an archive backup list based on the archive backup information and the information arrangement rule; Obtain a list storage database, and store the archive backup list in the list storage database.

[0012] Optionally, after storing the archive backup list in the list storage database, the method further includes: Obtaining the backup carrier of the backup electronic file and the storage information of the backup carrier; Generate an archive usage form based on the in-and-out information; Obtaining usage information of the backup carrier; A flow tracking record is generated based on the archive usage form and the usage information.

[0013] In the second aspect, the present application provides an electronic archive long-term preservation system based on metadata template parsing, which adopts the following technical solutions: A long-term electronic archive preservation system based on metadata template analysis, comprising: An electronic archive acquisition module, used to acquire the electronic archive to be stored and the archive basic information of the electronic archive to be stored; A data file generation module, used to generate and store a metadata file based on a preset metadata template, the electronic archive to be stored and the basic information of the archive; A storage location determination module, used to determine the archive storage location of the electronic archive to be stored based on the archive basic information; A verification rule acquisition module is used to obtain archive data verification rules; A verification result generating module, used to verify the metadata file and the electronic archive to be stored based on the archive data verification rule, and generate a verification result; The electronic archive storage module is used to store and save the electronic archive to be stored based on the archive storage location, the verification result and the metadata file.

[0014] By adopting the above technical solution, the electronic archives to be stored are parsed and integrated using the preset metadata template and the basic information of the archives, and a metadata file is generated. The metadata file carrying the information of the electronic archives to be stored is stored, so that when there is a problem with the electronic archives to be stored, the metadata file can be used to rescue the electronic archives to be stored. At the same time, the archive storage location most suitable for the electronic archives to be stored is determined according to the basic information of the archives, and the metadata file and the electronic archives to be stored are verified according to the archive data verification rules. The electronic archives to be stored are stored and preserved through the verification results and metadata files finally generated, so that the electronic archives to be stored are stored in the most suitable location, and the metadata files are used for safe processing, which can reduce the possibility of accidental damage and irrecoverable damage to the electronic archives to be stored, thereby realizing the demand for efficient and orderly long-term preservation of electronic archives.

[0015] In a third aspect, the present application provides an electronic device, which adopts the following technical solution: An electronic device comprises a processor, wherein the processor is coupled to a memory; The processor is used to execute the computer program stored in the memory so that the electronic device executes the computer program of the electronic archive long-term preservation method based on metadata template parsing as described in any one of the first aspects.

[0016] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution: A computer-readable storage medium stores a computer program that can be loaded by a processor and execute the electronic archive long-term preservation method based on metadata template parsing as described in any one of the first aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a flowchart of a method for long-term preservation of electronic archives based on metadata template parsing provided in an embodiment of the present application.

[0018] Figure 2 It is a structural block diagram of an electronic archive long-term preservation system based on metadata template parsing provided in an embodiment of the present application.

[0019] Figure 3 It is a structural block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0020] The present application is further described in detail below in conjunction with the accompanying drawings.

[0021] The embodiment of the present application provides a method for long-term preservation of electronic archives based on metadata template parsing, which can be executed by an electronic device, which can be a server or a terminal device, wherein the server can be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The terminal device can be a smart phone, a tablet computer, a desktop computer, etc., but is not limited thereto.

[0022] In the relevant technologies, when faced with massive electronic archives, there is a lack of effective integrated management methods, especially in metadata processing. It is impossible to fully utilize metadata to achieve accurate management and efficient retrieval of archives, resulting in difficulty in ensuring the quality and efficiency of long-term preservation of electronic archives.

[0023] Figure 1 A flowchart of a method for long-term preservation of electronic archives based on metadata template parsing provided in an embodiment of the present application.

[0024] like Figure 1As shown, the main process of the method is described as follows (steps S101 to S106): Step S101, obtaining the electronic archive to be stored and the basic archive information of the electronic archive to be stored.

[0025] In this embodiment, the electronic archives to be stored are electronic archives of various formats received for the first time from various data sources. The data sources of the electronic archives to be stored include network transmission, local storage devices, mobile terminals and other sources. After receiving the electronic archives to be stored, the received electronic archives to be stored are preliminarily analyzed to obtain basic archive information. The basic archive information includes archive size, archive file type, archive source and archive receiving time, etc. Among them, the electronic archive file format includes layout files, RTF, WPS, DOCX, JPG, TIF, PNG, STEP, WAV, MP3, XLS, DBF, XML, HTML and other electronic formats that can be parsed by computers. It should be noted that the basic archive information and archive file formats include but are not limited to the above-mentioned examples, and can also be added and adjusted according to the actual storage and parsing capabilities, and are not specifically limited here.

[0026] Step S102: Generate and store a metadata file based on a preset metadata template, the electronic archive to be stored and the basic information of the archive.

[0027] For step S102, the archive file type of the electronic archive to be stored is determined based on the archive basic information; the preset metadata template is selected based on the archive file type to determine the target parsing template; the metadata content of the electronic archive to be stored is parsed based on the target parsing template to generate a metadata file; the metadata file is processed as structured data to generate a structured metadata file; the file storage rules of the metadata file are obtained; and the structured metadata file is stored in a preset storage database based on the file storage rules.

[0028] In this embodiment, the preset metadata template is a custom data template constructed by the staff according to electronic archives of different file types. Electronic archives of different file types include document archives, image archives, and audio archives, etc. Each constructed template contains multiple metadata fields, such as archive name, creation time, author, file format, subject keywords, etc., and defines the data type, format requirements and constraints of each metadata field. For example, for document archives, it is stipulated that the "creation time" field must follow a specific date and time format, such as YYYY-MM-DD HH:MM:SS, YY-MM-DD HH:MM:SS, YY-MD HH:MM:SS, etc., and the staff can modify, delete and version the existing templates according to actual needs, so as to ensure the accuracy and timeliness of the target parsing template used.

[0029] The file type is extracted from the basic information of the archive to obtain the archive file type of the electronic archive to be stored, the archive file type is matched with the file type corresponding to the preset metadata template, the preset metadata template with the same file type and archive file type is used as the target parsing template, the electronic archive to be stored is extracted according to the parsing content set in the target parsing template, and the archive content obtained by parsing and extracting is written into the target parsing template according to the extraction position to obtain a metadata file, after obtaining the metadata file, the metadata file is converted into a structured file that is more convenient for storage and query to obtain a structured metadata file, and the structured metadata file is stored in a preset storage database according to the file storage rules, wherein the file storage rules are to mark the structured metadata file according to the archive file type of the electronic archive to be stored that generates the metadata file, and store the structured metadata files belonging to the same archive file type in the same database group of the preset storage database to facilitate management and maintenance operations by the staff.

[0030] When performing content parsing, it is necessary to use the parsing engine to search in the electronic archives to be stored according to the parsing content set in the target parsing template. After obtaining the corresponding data, the data is filled into the corresponding position of the target parsing template. After all the parsing content is found and filled, the final metadata file is obtained. For example, for an electronic document in PDF format, the parsing engine can accurately extract metadata such as the title, author, creation date, etc. in the document, and store it in the format defined by the template. For image archives, it may extract relevant metadata such as shooting time, shooting location, and resolution; for audio archives, it may extract recording time, duration, audio encoding format and other information. At the same time, during the parsing process, data that does not meet the template requirements will be marked and prompted to facilitate staff to adjust and modify the preset metadata template.

[0031] Step S103: determining the archive storage location of the electronic archive to be stored based on the archive basic information.

[0032] For step S103, the archive access data and archive size of the electronic archive to be stored are determined based on the archive basic information; the system storage resource information is obtained; the estimated storage location of the electronic archive to be stored is determined based on the archive access data and the system storage resource information; based on the archive size and the system storage resource information, it is judged whether the estimated storage location can store the electronic archive to be stored; if the estimated storage location can store the electronic archive to be stored, the estimated storage location is used as the archive storage location; if the estimated storage location cannot store the electronic archive to be stored, the retention period of the electronic archive to be stored is obtained; the estimated storage location is adjusted based on the retention period and the archive size to generate the archive storage location.

[0033] In this embodiment, the archive access data is the number of accesses to the electronic archives to be stored, and the system storage resource information includes the storage location of the system and the available capacity of each storage location, wherein the storage location includes local storage, mobile hard disk, optical disk, etc. When determining the archive storage location, considering the reading speed of the archive, it is necessary to first make a preliminary division of the storage location of the electronic archives to be stored according to the archive access data, that is, the frequently accessed electronic archives to be stored are stored in the high-speed hard disk storage area, and the electronic archives to be stored that are stored for a long time and have a low access frequency are regularly migrated and stored in the optical disk storage medium area, and then the selected storage location is used as the estimated storage location. After determining the preset storage location, it is necessary to further determine whether the available capacity of the estimated storage location is not less than the file size of the electronic archive to be stored. If not, the estimated storage location is used as the archive storage location, and the electronic archive to be stored is directly stored in the archive storage location. If less, the estimated storage location needs to be adjusted according to the retention period and file size of the electronic archive to be stored to generate the archive storage location.

[0034] Since the retention periods of the electronic archives to be stored are different, their storage locations are also affected to a certain extent. First, determine whether there are expiring archives in the expected storage location. If there are expiring archives, move them to any low-speed storage location. If there are no expiring archives, determine the storage location that can store the electronic archives to be stored based on the size of the archives, and use it as the storage location to be stored. Then, select a storage location among the storage locations that has a similar function to the preset storage location, use it as the archive storage location, and store the electronic archives to be stored in the archive storage location.

[0035] It should be noted that the setting standards for frequent access and low access frequency need to be set according to actual needs. For example, one thousand times a day is frequent access, and ten times a day is low access frequency, etc., and for different electronic archives to be stored, the time for adjusting their storage locations after the access frequency decreases or increases is also different, and all need to be set according to actual needs. At the same time, the time setting for expiring archives will also be adjusted according to the archive file type of the electronic archives to be stored. The setting of the above content is not limited here.

[0036] Step S104, obtaining archive data verification rules.

[0037] In this embodiment, the archive data verification rules include verification of four aspects of the electronic archives to be stored, including the authenticity, availability and completeness of the electronic archives to be stored, and the integrity of the electronic archives to be stored and metadata files. When verifying these four aspects, the verification order is not limited.

[0038] Step S105: verify the metadata file and the electronic archive to be stored based on the archive data verification rules to generate a verification result.

[0039] In this embodiment, when verifying the authenticity of the electronic file to be stored, unique technical means such as digital signature verification and hash algorithm verification can be used for verification. For example, after receiving the electronic file to be stored, the original hash value of the electronic file to be stored and the calculation data used to calculate the original hash value are obtained, and the data matching the calculation data in the received electronic file to be stored are extracted, and the extracted data are used to perform a hash operation, and the two hash values ​​are compared to determine the authenticity of the electronic file to be stored. The calculation data may be data that will change after modification, such as the header number, file generation date, and file last storage time in the electronic file to be stored. By comparing whether the two hash values ​​are consistent, it can be verified whether the electronic file to be stored has been tampered with during the transmission and receiving storage process.

[0040] When verifying the availability of the electronic archives to be stored, the main focus is on verifying their opening, reading and use. Different software environments and hardware devices are simulated and set up, and access tests are performed on the electronic archives to be stored under different software environments and hardware devices. It is tested that the electronic archives to be stored can be opened, read and used normally in various environments to ensure that the electronic archives to be stored can maintain availability in various possible usage scenarios.

[0041] When verifying the security of the electronic files to be stored, the restriction information of the electronic files to be stored is collected. The restriction information includes access rights and file encryption. The electronic files to be stored need to be set with permissions according to user roles, and sensitive files need to be encrypted and stored, so as to reduce the possibility of damage and leakage of the electronic files to be stored during storage and transmission, so as to ensure the security of the electronic files to be stored.

[0042] When verifying the integrity of the electronic archives and metadata files to be stored, it is necessary to confirm the actual size of the electronic archives and metadata files to be stored and compare the actual size with the expected size. At the same time, it is also necessary to verify the file structure integrity of the electronic archives and metadata files to be stored to determine whether there are any deleted places in the electronic archives and metadata files to be stored, so that the subsequently stored electronic archives and metadata files are complete.

[0043] When all the above four aspects of verification are passed, the verification result will be set to successful verification. If any one of the aspects of verification fails, the verification result will be set to unsuccessful, and an early warning will be processed. The verification failure information will be sent to the manager's mobile terminal to facilitate manual verification and tracing by the manager.

[0044] Step S106, storing and preserving the electronic archive to be stored based on the archive storage location, verification result and metadata file.

[0045] In this embodiment, the metadata file is bound to the electronic archive to be stored, so that after the metadata file is determined, its corresponding electronic archive to be stored can be directly determined. Since the metadata file is a file containing key information obtained by extracting the electronic archive to be stored, its own size is smaller than the file size of the electronic archive to be stored, which is more convenient for computer processing during query or extraction. Therefore, the required metadata file can be determined first, and the electronic archive to be stored can be determined based on the metadata file, which can speed up the search speed and reduce the processing pressure of the computer. Then, check whether the verification result is passed. If the verification result is passed, the electronic archive to be stored is stored in the archive storage location for preservation processing.

[0046] In this embodiment, the storage status of the electronic archive to be stored is automatically inspected in real time to generate automatic inspection information; whether the electronic archive to be stored is safe is determined based on the automatic inspection information; if the electronic archive to be stored is safe, the step of automatically inspecting the storage status of the electronic archive to be stored in real time is repeated; if the electronic archive to be stored is not safe, the storage abnormality type of the electronic archive to be stored is determined based on the automatic inspection information; the abnormality solution for the electronic archive to be stored is determined based on the storage abnormality type; and an archive inspection report is generated based on the automatic inspection information, the storage abnormality type and the abnormality solution.

[0047] According to the preset inspection sequence, the storage status of the equipment storing the electronic archives to be stored is automatically inspected in sequence, the integrity, accuracy and security of the electronic archives to be stored are inspected, the running status, integrity and readability of the equipment are inspected, the inspection results are automatically summarized to obtain automatic inspection information, and abnormal information is extracted from the inspection information. If no abnormal information is extracted, the electronic archives to be stored will be determined to be safe, and then the inspection is repeated according to the above preset inspection sequence and the automatic inspection information is continuously generated. If abnormal information is extracted, it is first determined whether the abnormal information comes from the electronic archives to be stored or from the equipment. If it comes from the equipment, the storage abnormality type is determined to be equipment abnormality, and the abnormality solution is equipment maintenance alarm. The equipment information is obtained, and the abnormality solution is generated according to the equipment information and the equipment maintenance alarm, and the automatic inspection information, equipment abnormality and abnormality solution are bound to generate an archive inspection report. If it comes from the electronic archives to be stored, the storage abnormality type is determined to be data abnormality, and the abnormality solution is data recovery, and the automatic inspection information, data abnormality and abnormality solution are bound to generate an archive inspection report.

[0048] Among them, the specific recovery steps of data recovery include locating the storage location of the electronic archive to be stored where abnormal data appears, reading the electronic archive to be stored, and starting the data recovery program, searching for the metadata file and backup file of the electronic archive to be stored, extracting valid data corresponding to the abnormal data from the metadata file or the backup file, and transmitting the extracted valid data to the storage location of the electronic archive to be stored for data recovery. During the data recovery process, a data verification mechanism is used to verify the valid data and the undamaged data in the electronic archive to be stored to ensure that the recovered data is consistent with the original data and the period completion. After the complete recovery is completed, the restored electronic archive to be stored is reconstructed so that the electronic archive to be stored adapts to the current operating environment, and the operation and reading, writing and other functions are tested. After the test is completed, the inspection is repeated according to the above-mentioned preset inspection sequence and the automatic inspection information is continued to be generated. In this embodiment, in response to the user's electronic archive query operation, the query content input by the user is obtained; the query content is standardized to generate keywords to be queried; the query conversion rule is obtained; the query content is converted into a query statement based on the query conversion rule and the keywords to be queried; a content query is performed based on the query statement and the metadata file to generate a query result; it is determined whether the query result is empty; if the query result is not empty, a target electronic archive is determined based on the query result; the target electronic archive is fed back to the user's query end; if the query result is empty, a content query is performed based on the query statement and the electronic archive to be stored to determine the target electronic archive; the target electronic archive is fed back to the user's query end.

[0049] After storing the electronic archives and metadata files to be stored in the storage location and database, first make settings that are easy to query based on the electronic archives and metadata files to be stored. For metadata files, when creating a preset storage database for storing metadata files, establish a suitable index structure for each field of metadata. For example, for common search fields such as archive name, author, creation time, subject keywords, etc., create a B-tree index (in relational databases such as MySQL, PostgreSQL) or a hash index (in some databases that support hash indexes) to improve the query speed of these fields. For multi-field combined retrieval, create a joint index. For example, if users often search based on "author" and "creation time" at the same time, you can create a joint index containing these two fields (author, creation_time), and pay attention to the field order of the joint index. Fields with high discrimination and strong selectivity should be placed in front to improve index efficiency and query performance.

[0050] For the electronic archives to be stored, use Chinese word segmentation tools, such as Jieba word segmentation library, or English natural language processing tools, such as word segmenters in the NLTK library, to segment the text into meaningful words or phrases so that search engines can better understand and index the text content. For example, for the text "Application of electronic archive management system", after word segmentation, the words "electronic", "archives", "management", "system", "of", "application" and so on are obtained, or "electronic", "archives", "management", "system", "application" and so on). In addition, some common stop words with no practical meaning are removed from the word segmentation results, such as "of", "is", "in" or "a", "an", "the", etc., so as to reduce the size of the index and the complexity of the search, and improve the search efficiency and accuracy. It is also necessary to restore the words to their basic form, such as restoring "running" to "run", "walks" to "walk", etc., to reduce the diversity of vocabulary and improve the recall rate of the search. Through these preprocessing steps, a text representation that is more suitable for indexing and searching is generated.

[0051] After the above processing, the user will be able to perform electronic archive query operations. After receiving the user's electronic archive query request, the query content contained in the request is extracted and standardized to remove useless words such as modal particles and linking words. For example, if the user enters "electronic archives of author Zhang San", the keywords to be queried after standardization are author and Zhang San. Then the query conversion rules and the keywords to be queried convert the query content into a query statement, that is, generate an SQL query statement similar to SELECT * FROM archives WHERE author = 'Zhang San', so that the electronic archive records that meet the conditions can be quickly located through the index of the author field, and the metadata query results that are frequently retrieved are cached in memory. You can use a memory cache database such as Redis and set a reasonable cache expiration time. When the same search condition is encountered next time, first check whether there is a corresponding result in the cache. If it exists, it is directly obtained from the cache and returned to the user, avoiding repeated database query operations and improving the query response speed.

[0052] However, when performing a query, there may be a situation where the query content entered by the user contains the text content of the electronic archive to be stored instead of the name content, or the query content entered by the user is not recorded in the metadata file. In this case, the query result will be empty, and it is necessary to perform a document content query on the electronic archive to be stored.

[0053] When querying the electronic archives to be stored, the query content is converted into a query syntax that the full-text search engine can understand and sent to the search engine to perform the search operation. For example, if the user enters "electronic archives containing 'data security' in the archives", the system will convert it into a query statement for the full-text search engine (such as GET / archives_index / _search?q=content:"data security" in Elasticsearch), and then obtain the search results. It should be noted that the full-text search engine will sort the search results according to the relevance of the text. The relevance sorting usually considers multiple factors, such as the frequency of occurrence of keywords in the text, the position of keywords, such as the title, the beginning of the text has a higher weight, the length of the document (keywords in shorter documents may be more relevant), etc. The results returned by the full-text search engine sorted by relevance are merged and comprehensively sorted with the results of metadata screening, and finally presented to the user a list of electronic archive retrieval results that is both accurate and relevant to meet the user's needs for archive content retrieval.

[0054] In this embodiment, the archive backup information and information arrangement rules of the backed-up electronic archive are obtained; the archive backup list is generated based on the archive backup information and the information arrangement rules; the list storage database is obtained, and the archive backup list is stored in the list storage database.

[0055] The backup electronic archive is the backup data of part or all of the electronic archives to be stored. In order to ensure the safety of the electronic archives and facilitate subsequent accountability, it is necessary to organize and summarize the backup electronic archives, and store the summarized data. A file backup list is generated according to the archive backup information and information arrangement rules, and the generated file backup list is stored in the list storage database, wherein the archive backup information includes the name of the backed-up electronic archive to be stored, the backup carrier where the backup is located, the carrier name of the backup carrier, etc. The information arrangement rule is to divide the backup carriers into groups according to the names of the backup carriers, and divide the backup carriers of the same name type into a group, for example, a hard disk group, an optical drive group, and a cloud storage group, etc. Afterwards, the electronic archives to be stored in each group are summarized to generate a backup archive table. Each group corresponds to a backup archive table, and all the backup archive tables are summarized to obtain the final archive backup list.

[0056] In this embodiment, the backup carrier of the backed-up electronic archive and the storage-in and storage-out information of the backup carrier are obtained; an archive usage form is generated based on the storage-in and storage-out information; usage information of the backup carrier is obtained; and a flow tracking record is generated based on the archive usage form and the usage information.

[0057] In order to ensure the security of electronic archives, in addition to restricting the reading of the stored electronic archives themselves, it is also necessary to restrict the backup electronic archives. Access rights and usage rights are also set for the backup electronic archives, that is, staff who do not have access rights and usage rights cannot read the contents of the backup carrier, nor can they take the backup carrier out of the preset carrier storage library. In addition, when the backup carrier carrying the backup electronic archive is put in and out of the warehouse, it is necessary to record it, that is, scan the backup carrier, record its user, usage time, return time and other entry and exit information, organize the entry and exit information of all backup carriers according to the user, generate an archive usage form, and perform security verification and read scan on the backup carrier after it is put into the warehouse to obtain the usage information of the backup carrier, bind the usage information to the entry and exit information in the corresponding usage form, and obtain a flow tracking record. When there is a problem with the backup carrier or the backup electronic archive, it can be held accountable in a timely manner according to the flow tracking record.

[0058] Figure 2 A structural block diagram of an electronic archive long-term preservation system 200 based on metadata template parsing provided in an embodiment of the application.

[0059] like Figure 2 As shown, the electronic archive long-term preservation system 200 based on metadata template parsing mainly includes: The electronic archive acquisition module 201 is used to acquire the electronic archive to be stored and the archive basic information of the electronic archive to be stored; A data file generation module 202 is used to generate and store a metadata file based on a preset metadata template, the electronic archive to be stored and the basic information of the archive; The storage location determination module 203 is used to determine the archive storage location of the electronic archive to be stored based on the archive basic information; A verification rule acquisition module 204 is used to acquire archive data verification rules; The verification result generating module 205 is used to verify the metadata file and the electronic archive to be stored based on the archive data verification rules and generate a verification result; The electronic archive storage module 206 is used to store and preserve the electronic archive to be stored based on the archive storage location, verification results and metadata files.

[0060] As an optional implementation of this embodiment, the data file generation module 202 is specifically used to determine the archive file type of the electronic archive to be stored based on the archive basic information; select the preset metadata template based on the archive file type to determine the target parsing template; perform metadata content analysis on the electronic archive to be stored based on the target parsing template to generate a metadata file; perform structured data processing on the metadata file to generate a structured metadata file; obtain the file storage rules of the metadata file; and store the structured metadata file in a preset storage database based on the file storage rules.

[0061] As an optional implementation of this embodiment, the storage location determination module 203 is specifically used to determine the archive access data and archive size of the electronic archive to be stored based on the archive basic information; obtain system storage resource information; determine the estimated storage location of the electronic archive to be stored based on the archive access data and the system storage resource information; determine whether the estimated storage location can store the electronic archive to be stored based on the archive size and the system storage resource information; if the estimated storage location can store the electronic archive to be stored, use the estimated storage location as the archive storage location; if the estimated storage location cannot store the electronic archive to be stored, obtain the retention period of the electronic archive to be stored; adjust the estimated storage location based on the retention period and the archive size to generate the archive storage location.

[0062] As an optional implementation of this embodiment, the electronic archive long-term preservation system 200 based on metadata template parsing also includes: The inspection information generation module is used to automatically inspect the storage status of the electronic archives to be stored in real time and generate automatic inspection information; The file security judgment module is used to judge whether the electronic file to be stored is safe based on the automatic inspection information; An automatic inspection repetition module is used to repeat the steps of automatically inspecting the storage status of the electronic archives to be stored in real time; An abnormality type determination module, used to determine the storage abnormality type of the electronic archive to be stored based on the automatic inspection information; A solution determination module, used to determine an abnormal solution for the electronic archive to be stored based on the storage abnormality type; The inspection report generation module is used to generate archive inspection reports based on automatic inspection information, storage exception types and exception solutions.

[0063] As an optional implementation of this embodiment, the electronic archive long-term preservation system 200 based on metadata template parsing also includes: A query operation response module, used to respond to the user's electronic archive query operation and obtain the query content input by the user; The key word generation module is used to standardize the query content and generate the keywords to be queried; A conversion rule acquisition module is used to obtain query conversion rules; A query statement conversion module, used to convert the query content into a query statement based on the query conversion rules and the keywords to be queried; A query result generation module, used to perform content query based on query statements and metadata files and generate query results; A query result judgment module is used to judge whether the query result is empty; A first file determination module, used to determine a target electronic file based on the query result; The first file feedback module is used to feed back the target electronic file to the user's query terminal; The second file determination module is used to perform content query based on the query statement and the electronic file to be stored, and determine the target electronic file; The second file feedback module is used to feed back the target electronic file to the user's query terminal.

[0064] As an optional implementation of this embodiment, the electronic archive long-term preservation system 200 based on metadata template parsing also includes: A backup information acquisition module is used to acquire archive backup information and information arrangement rules of backup electronic archives; A backup list generation module, used to generate an archive backup list based on archive backup information and information arrangement rules; The backup list storage module is used to obtain the list storage database and store the archive backup list in the list storage database.

[0065] As an optional implementation of this embodiment, the electronic archive long-term preservation system 200 based on metadata template parsing also includes: The carrier information acquisition module is used to obtain the backup carrier of the backup electronic file and the storage information of the backup carrier; Use the form generation module to generate archive usage forms based on the in / out information; A usage information acquisition module is used to obtain usage information of the backup carrier; The tracking record generation module is used to generate flow tracking records based on the archive usage form and usage information.

[0066] In one example, the module in any of the above devices can be one or more integrated circuits configured to implement the above methods, such as: one or more application specific integrated circuits (ASICs), or, one or more digital signal processors (DSPs), or, one or more field programmable gate arrays (FPGAs), or a combination of at least two of these integrated circuit forms.

[0067] For another example, when the modules in the device can be implemented in the form of a processing element scheduling program, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call a program. For another example, these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0068] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0069] Figure 3 This is a structural block diagram of an electronic device 300 provided in an embodiment of the present application.

[0070] like Figure 3 As shown, the electronic device 300 includes a processor 301 and a memory 302 , and may further include an information input / information output (I / O) interface 303 , one or more of a communication component 304 , and a communication bus 305 .

[0071] The processor 301 is used to control the overall operation of the electronic device 300 to complete all or part of the steps of the above-mentioned method for long-term preservation of electronic archives based on metadata template parsing; the memory 302 is used to store various types of data to support the operation of the electronic device 300, and these data may include, for example, instructions for any application or method used to operate on the electronic device 300, and data related to the application. The memory 302 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0072] The I / O interface 303 provides an interface between the processor 301 and other interface modules, and the above-mentioned other interface modules can be keyboards, mice, buttons, etc. These buttons can be virtual buttons or physical buttons. The communication component 304 is used for wired or wireless communication between the electronic device 300 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G or 4G, or a combination of one or more of them, so the corresponding communication component 104 can include: Wi-Fi components, Bluetooth components, NFC components.

[0073] The electronic device 300 can be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), controllers, microcontrollers, microprocessors or other electronic components to execute the electronic archive long-term preservation method based on metadata template parsing given in the above embodiment.

[0074] The communication bus 305 may include a path to transmit information between the above components. The communication bus 305 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The communication bus 305 may be divided into an address bus, a data bus, a control bus, etc.

[0075] The electronic device 300 may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc., and may also be servers, etc.

[0076] The present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned method for long-term preservation of electronic archives based on metadata template parsing are implemented.

[0077] The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0078] The terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not expressly listed, or also includes elements inherent to such process, method, article, or apparatus.

[0079] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of application involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the aforementioned application concept. For example, the above features are replaced with (but not limited to) technical features with similar functions applied in the present application.

Claims

1. A method for long-term preservation of electronic archives based on metadata template analysis, characterized in that: include: Acquire the electronic archive to be stored and the basic archive information of the electronic archive to be stored; Generate and store a metadata file based on a preset metadata template, the electronic archive to be stored and the basic information of the archive; Determine the archive storage location of the electronic archive to be stored based on the archive basic information; Get the archival data validation rules; Verifying the metadata file and the electronic archive to be stored based on the archive data verification rule, and generating a verification result; The electronic archive to be stored is stored and preserved based on the archive storage location, the verification result and the metadata file.

2. The method according to claim 1, characterized in that The step of generating and storing a metadata file based on a preset metadata template, the electronic archive to be stored and the archive basic information comprises: Determine the archive file type of the electronic archive to be stored based on the archive basic information; Selecting the preset metadata template based on the archive file type to determine a target parsing template; Performing metadata content analysis on the electronic archive to be stored based on the target analysis template to generate a metadata file; Performing structured data processing on the metadata file to generate a structured metadata file; Get the file storage rules of the metadata file; The structured metadata file is stored in a preset storage database based on the file storage rule.

3. The method according to claim 1, characterized in that The step of determining the archive storage location of the electronic archive to be stored based on the archive basic information includes: Determine the archive access data and archive size of the electronic archive to be stored based on the archive basic information; Get system storage resource information; Determining an estimated storage location of the electronic archive to be stored based on the archive access data and the system storage resource information; Determining whether the estimated storage location can store the electronic file to be stored based on the file size and the system storage resource information; If the estimated storage location can store the electronic file to be stored, the estimated storage location is used as the file storage location; If the estimated storage location cannot store the electronic file to be stored, obtaining the retention period of the electronic file to be stored; The estimated storage location is adjusted based on the retention period and the archive size to generate an archive storage location.

4. The method according to claim 1, characterized in that: After storing and saving the electronic archive to be stored based on the archive storage location, the verification result and the metadata file, the method further includes: Performing automatic inspection on the storage status of the electronic archive to be stored in real time and generating automatic inspection information; Determining whether the electronic file to be stored is safe based on the automatic inspection information; If the electronic file to be stored is safe, repeating the step of automatically inspecting the storage status of the electronic file to be stored in real time; If the electronic file to be stored is not safe, determining the storage abnormality type of the electronic file to be stored based on the automatic inspection information; Determine an abnormal solution for the electronic archive to be stored based on the storage abnormality type; An archive inspection report is generated based on the automatic inspection information, the storage exception type and the exception solution.

5. The method according to claim 1, characterized in that: The method further comprises: In response to a user's electronic archive query operation, obtaining query content input by the user; Standardizing the query content to generate keywords to be queried; Get query conversion rules; Converting the query content into a query statement based on the query conversion rule and the keywords to be queried; Performing content query based on the query statement and the metadata file to generate query results; Determine whether the query result is empty; If the query result is not empty, determining the target electronic file based on the query result; Feeding back the target electronic file to the query terminal of the user; If the query result is empty, then performing a content query based on the query statement and the electronic archive to be stored to determine the target electronic archive; The target electronic file is fed back to the query end of the user.

6. The method according to claim 1, characterized in that The method further comprises: Obtaining archive backup information and information arrangement rules for backup electronic archives; Generate an archive backup list based on the archive backup information and the information arrangement rule; Obtain a list storage database, and store the archive backup list in the list storage database.

7. The method according to claim 6, characterized in that After storing the archive backup list in the list storage database, the method further includes: Obtaining the backup carrier of the backup electronic file and the storage information of the backup carrier; Generate an archive usage form based on the storage in and out information; Obtaining usage information of the backup carrier; A flow tracking record is generated based on the archive usage form and the usage information.

8. A long-term electronic archive preservation system based on metadata template analysis, characterized in that: include: An electronic archive acquisition module, used to acquire the electronic archive to be stored and the archive basic information of the electronic archive to be stored; A data file generation module, used to generate and store a metadata file based on a preset metadata template, the electronic archive to be stored and the basic information of the archive; A storage location determination module, used to determine the archive storage location of the electronic archive to be stored based on the archive basic information; A verification rule acquisition module is used to obtain archive data verification rules; A verification result generating module, used to verify the metadata file and the electronic archive to be stored based on the archive data verification rule, and generate a verification result; The electronic archive storage module is used to store and save the electronic archive to be stored based on the archive storage location, the verification result and the metadata file.

9. An electronic device, characterized in that: comprising a processor coupled to a memory; The processor is configured to execute a computer program stored in the memory, so that the electronic device executes the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The method comprises a computer program or an instruction, which, when executed on a computer, causes the computer to execute the method according to any one of claims 1 to 7.

Images