Electronic records pre-archiving apparatus, method, device and medium

Abstract

This application relates to the field of securities and futures archive management technology, and discloses an electronic archive pre-archiving device, method, equipment, and medium. The device includes: a data receiving module for receiving metadata and electronic files pushed from a source system, with a one-to-one correspondence between the metadata and electronic files; a four-property detection module for performing four-property checks on the metadata and electronic files based on a pre-set four-property detection model; a metadata cleaning module for cleaning the metadata after the four-property checks based on a pre-set data cleaning model; a pre-archiving information package generation module for encapsulating the cleaned metadata and electronic files into a pre-archiving information package based on a pre-set pre-archiving information package model; and a pre-archiving information package push module for pushing the pre-archiving information package to the archive system based on a pre-set push model. This application performs four-property checks on archive data during the pre-archiving process, achieving single-set paperless archiving.

Description

Technical Field

[0001] This application relates to the field of securities and futures file management technology, and more specifically, to an electronic file pre-archiving device, method, equipment, and medium. Background Technology

[0002] Securities and futures firms generally employ a "dual-system" approach to record management: for the same business transaction, while electronic data is being archived, a paper copy must also be produced and archived simultaneously. This model has the following drawbacks in both the paper and electronic record dimensions: (a) Paper archives After a transaction is completed, documents such as transaction confirmations, customer agreements, and regulatory reports must be printed, physically stamped, scanned, and archived before being transferred offline to the archives along with the electronic documents. This archiving process involves multiple departments, including business, operations, and archives, and is complex, resulting in high printing costs, low efficiency of manual inventory checks, and large warehouse space requirements, which does not meet the regulatory requirements for green operations and cost reduction and efficiency improvement.

[0003] (ii) Electronic records Each business system develops its own archiving function to generate electronic information packages, which are then centrally pushed to the archive system. The archive system then conducts unified checks on authenticity, completeness, usability, and security (four properties). Non-standard data is only discovered after it has entered the archive database, requiring manual return to the source system for correction. This increases the workload of the archive system and delays the archiving time.

[0004] In summary, the current "dual system" cannot achieve efficient, low-cost, and sustainable archival management at either the paper or electronic level. Summary of the Invention

[0005] In view of the above situation, this application provides an electronic archive pre-archiving device, method, equipment and medium, which aims to solve the above problems or at least partially solve the above problems.

[0006] In a first aspect, this application provides an electronic document pre-archiving device, comprising: The data receiving module is used to receive metadata and electronic files pushed by the source system, and the metadata and electronic files are set to correspond one-to-one. The four-property detection module is used to perform four-property detection on the metadata and the electronic document based on a pre-set four-property detection model; The metadata cleaning module is used to clean the metadata after the four properties detection based on a pre-set data cleaning model. A pre-archived information package generation module is used to encapsulate the cleaned metadata and the electronic files into a pre-archived information package based on a pre-set pre-archived information package model. The pre-archived information package push module pushes the pre-archived information package to the archive system based on a pre-set push model.

[0007] For example, the data receiving module is also configured to receive the metadata and the electronic file in parallel, wherein the metadata includes a source-side SM3 digest of the metadata and a source-side SM3 digest of the electronic file.

[0008] For example, the four-property detection module is further configured to determine the source-side SM3 digest of the metadata, the source-side SM3 digest of the electronic file, the source-side size of the electronic file, the source-side sending timestamp, the platform-side SM3 digest of the metadata, the platform-side SM3 digest of the electronic file, the platform-side size of the electronic file, and the platform-side receiving timestamp based on the metadata and the electronic file. The four-property detection module is also used to compare the source-side SM3 digest of the metadata with the platform-side SM3 digest of the metadata, compare the source-side SM3 digest of the electronic file with the platform-side SM3 digest of the electronic file, compare the source-side size of the electronic file with the platform-side size of the electronic file, and compare the source-side sending timestamp with the platform-side receiving timestamp. Based on the comparison results, a first-level verification is performed on the metadata and its corresponding electronic file. The first-level verification includes authenticity and integrity verification. The four-property detection module is also used to parse electronic files based on a pre-set file parsing tool, and to perform a second verification on the electronic files based on the parsing results. The second verification includes availability verification. The four-property detection module is also used to perform a third layer of verification on the metadata and its corresponding electronic files based on a pre-set security scanning tool. The third layer of verification includes security verification.

[0009] For example, the four-property detection module is also used to determine that the verification has failed and generate a detection report based on a preset report template when any one of the first verification, the second verification, and the third verification fails. The four-property detection module is also used to determine that the verification is passed when all three verifications in the first verification, the second verification, and the third verification are passed.

[0010] For example, the module for generating pre-archived information packages is also used to generate identification codes for the metadata and electronic documents after data cleaning; The module for generating pre-archived information packages is also used to construct a mapping relationship between the SM3 digest of the metadata and the SM3 digest of the electronic file, and to store the SM3 digest of the metadata and the SM3 digest of the electronic file together. The module for generating pre-archived information packages is further configured to encapsulate the metadata and the electronic files into a pre-archived information package, and name the pre-archived information package according to the identification code.

[0011] For example, the pre-archived information package push module is also used to push the pre-archived information package to the archive system based on a pre-set push path.

[0012] For example, it also includes a business configuration module for configuring parameters of the data receiving module, the four-property detection module, the metadata cleaning module, the pre-archived information package generation module, and the pre-archived information package push module.

[0013] Secondly, this application provides a method for pre-archiving electronic documents, including: Receive metadata and electronic files pushed by the source system, and set a one-to-one correspondence between the metadata and the electronic files; Based on a pre-set four-property detection model, the metadata and the electronic document are subjected to four-property detection. Based on a pre-set data cleaning model, the metadata after the four properties detection is cleaned. Based on a pre-set pre-archived information package model, the metadata and electronic files after data cleaning are encapsulated into a pre-archived information package; Based on a pre-set push model, the pre-archived information package is pushed to the archive system.

[0014] Thirdly, this application provides a computer device including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the electronic document pre-archiving method as described in the second aspect.

[0015] Fourthly, this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the electronic document pre-archiving method as described in the second aspect.

[0016] The above-described technical solutions adopted in the embodiments of this application can achieve the following beneficial effects: This application sets up a pre-archiving device to receive archive data from the source system. During the pre-archiving process, the four properties of the archive data are checked, metadata is cleaned, information packages are encapsulated, and push operations are performed in advance and standardized. This enables zero-intrusion aggregation of heterogeneous data and interception of problematic data before it is put into the database. This reduces implementation and maintenance costs, improves archiving efficiency and data accuracy, saves paper consumables, and realizes paperless archiving of electronic documents in a single set. Attached Figure Description

[0017] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings: Figure 1 This is a schematic diagram of the structure of an electronic archive pre-archiving device according to an embodiment of the present invention; Figure 2 This is a schematic diagram of an application environment for an electronic archive pre-archiving method according to an embodiment of the present invention; Figure 3 This is a flowchart illustrating an electronic archive pre-archiving method according to an embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of a computer device according to an embodiment of the present invention; Figure 5 This is another structural schematic diagram of a computer device according to one embodiment of the present invention. Detailed Implementation

[0018] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0019] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such use can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the term "comprising" and its variations should be interpreted as open-ended terms meaning "including but not limited to."

[0020] The technical solutions provided by the various embodiments of this application are described in detail below with reference to the accompanying drawings.

[0021] As mentioned earlier, the current "dual-system" approach cannot achieve efficient, low-cost, and sustainable record management at either the paper or electronic level. To address this technical problem, this application provides an electronic record pre-archiving device.

[0022] In one embodiment, such as Figure 1As shown, the electronic archive pre-archiving device includes a data receiving module 101, a four-property detection module 102, a metadata cleaning module 103, a pre-archiving information package generation module 104, and a pre-archiving information package push module 105. The data receiving module 101 receives metadata and electronic files pushed from the source system, with each metadata and electronic file corresponding to the other. The four-property detection module 102 performs four-property detection on the metadata and electronic files based on a pre-set four-property detection model. The metadata cleaning module 103 cleans the metadata after the four-property detection based on a pre-set data cleaning model. The pre-archiving information package generation module 104 encapsulates the cleaned metadata and electronic files into a pre-archiving information package based on a pre-set pre-archiving information package model. The pre-archiving information package push module 105 pushes the pre-archiving information package to the archive system based on a pre-set push model. This application sets up a pre-archiving device to receive archive data from the source system. During the pre-archiving process, the four properties of the archive data are checked, metadata is cleaned, information packages are encapsulated, and push operations are performed in advance and standardized. This enables zero-intrusion aggregation of heterogeneous data and interception of problematic data before it is put into the database. This reduces implementation and maintenance costs, improves archiving efficiency and data accuracy, saves paper consumables, and realizes paperless archiving of electronic documents in a single set.

[0023] In one embodiment, the source system includes system A, system B, system C, ..., system N, etc. The data from the source system is heterogeneous data. The pre-archiving device is connected to the source system, and the archive system is connected to the pre-archiving device. Without modifying the source system and the archive system, the pre-archiving device enables the pre-processing of non-standard data, avoiding the step of manually returning the data from the archive system to the source system for correction, reducing the operating load of the archive system, and ensuring the timeliness of archiving.

[0024] In one embodiment, the data receiving module 101 is further configured to receive the metadata and the electronic file in parallel. The metadata includes a source-side SM3 digest of the metadata and a source-side SM3 digest of the electronic file. Specifically, the data receiving module 101 receives the metadata pushed by the source system via an ETL data exchange channel and downloads or reads the electronic file corresponding to the metadata through a standard encrypted interface or a self-encrypted shared storage area. This non-intrusive aggregation of archived data can be completed without any functional development by the source system. An SM3 digest is appended to both the metadata and the electronic file during parallel transmission to verify integrity and reliability. The source-side SM3 digest of the metadata is obtained by the source system through hash calculation of the structured metadata and is pushed along with the metadata; the source-side SM3 digest of the electronic file is obtained by the source system through hash calculation of the unstructured electronic file content and is written into the file_sm3 field of the metadata.

[0025] ETL (Extract, Transform, Load) data exchange channels are a technical architecture that automates the entire data extraction, transformation, and loading process. It primarily addresses three core issues: integration of heterogeneous data sources, standardized data processing, and cross-system data synchronization. Simply put, it acts as a "bridge" connecting business systems (such as ERP and CRM) with data warehouses / data lakes, ensuring that metadata, after cleaning and transformation, becomes usable analytical assets.

[0026] In one embodiment, the four-property detection module 102 is further configured to determine, based on the metadata and the electronic file, the source-side SM3 digest of the metadata, the source-side SM3 digest of the electronic file, the source-side size of the electronic file, the source-side sending timestamp, the platform-side SM3 digest of the metadata, the platform-side SM3 digest of the electronic file, the platform-side size of the electronic file, and the platform-side receiving timestamp. Specifically, the source-side SM3 digest of the metadata is pushed to the data receiving module 101 along with the metadata. The source-side SM3 digest of the electronic file is extracted from the metadata. The source-side size of the electronic file is recorded in the `file_size` field of the metadata by the source system when generating the electronic file. The source-side sending timestamp is written to the `create_time` field of the metadata by the source system when generating the electronic file. The platform-side SM3 digest of the metadata is obtained by the four-property detection module 102 performing a hash calculation on the metadata. The platform-side SM3 digest of the electronic file is obtained by the four-property detection module 102 performing a hash calculation on the electronic file. The platform-side size of the electronic file is obtained in real time by the data receiving module 101 through a file system interface, such as `os.path.getsize()`, after the electronic file is received. The platform automatically records the receiving time (receive_time) when the data receiving module 101 receives the file.

[0027] In one embodiment, the four-property detection module 102 is further configured to compare the source-side SM3 digest of the metadata with the platform-side SM3 digest of the metadata, the source-side SM3 digest of the electronic file with the platform-side SM3 digest of the electronic file, the source-side size of the electronic file with the platform-side size of the electronic file, and the source-side sending timestamp with the platform-side receiving timestamp. Based on the comparison results, a first layer of verification is performed on the metadata and its corresponding electronic file. This first layer of verification includes authenticity and integrity checks. Specifically, if the source-side SM3 digest of the metadata matches the platform-side SM3 digest of the metadata, and the source-side SM3 digest of the electronic file matches the platform-side SM3 digest of the electronic file, it indicates that the file content has not been tampered with. If the source-side size of the electronic file matches the platform-side size, it indicates that the file has not been lost / truncated. If the source-side sending timestamp and the platform-side receiving timestamp conform to a rule (e.g., the source-side sending timestamp is earlier than the platform-side receiving timestamp, and the platform-side receiving timestamp is no later than the current time), it indicates that the file generation time is authentic and valid. This ensures that the archived data is consistent with the source system.

[0028] In one embodiment, the four-property detection module 102 is further configured to parse the electronic document based on a pre-set file parsing tool, and perform a second layer of verification on the electronic document based on the parsing results. This second layer of verification includes usability verification. Specifically, the file parsing tool includes a file parser (such as a PDF / OCR engine), a format recognition engine (such as UTF-8), and verifies format compliance (such as whether it is an unalterable PDF / A format), encoding format, and text readability (such as whether the scanned document is clear and recognizable). This avoids files becoming unviewable due to format errors, such as rejecting corrupted image files or garbled text.

[0029] In one embodiment, the four-factor authentication module 102 is further configured to perform a third layer of verification on the metadata and its corresponding electronic files based on a pre-set security scanning tool. This third layer of verification includes security verification. Specifically, the security scanning tool includes antivirus software. The antivirus software is enabled to scan in real time and simultaneously verify the transmission channel encryption identifier (such as the transmission channel TLS encryption identifier) ​​and access control policies (such as IP whitelists) to complete the security detection, prevent virus files from entering the database or unauthorized access, and comply with the information security compliance requirements.

[0030] In one embodiment, the four-property detection module 102 is further configured to determine that a verification has failed and generate a test report based on a preset report template when any one of the first verification, the second verification, and the third verification fails. The test report includes error codes (such as "SM3 verification failed" or "format not supported"), abnormal fields, and rectification guidelines (such as providing processing / modification suggestions), and is delivered to the corresponding responsible personnel according to a preset notification strategy. After the personnel complete the correction, the source system is triggered to re-push the report to the pre-archiving device.

[0031] In one embodiment, the four-property detection module 102 is further configured to determine that the verification is passed and proceed to subsequent steps when all three verifications in the first verification, the second verification, and the third verification are passed.

[0032] In one embodiment, the metadata cleaning module 103 is used to perform unified cleaning, transformation, and completion based on the differences in metadata format and field standards of the source system, and in accordance with the metadata specifications of the archive category, to ensure that the archived data conforms to a unique, complete, and standardized controlled structure. Specifically, cleaning involves removing duplicate fields and correcting format errors, such as unifying dates to "YYYY-MM-DD"; transformation involves mapping fields according to the archive category specifications, such as "mobile phone number" → "contact number"; and completion involves filling in missing values ​​based on business rules, such as automatically completing the "resident / enterprise" label based on user type. This ensures that the metadata conforms to a controlled structure of "unique identifier, complete fields, and standardized format," laying the foundation for subsequent encapsulation. For example, the "user address" field pushed by different business systems is unified into the format "province-city-district-detailed address," and administrative division codes are added.

[0033] In one embodiment, the pre-archived information package generation module 104 is further configured to generate an identification code for the cleaned metadata and the electronic document. The pre-archived information package generation module 104 is also configured to construct a mapping relationship between the SM3 digest of the metadata and the SM3 digest of the electronic document, associating and storing the SM3 digest of the metadata and the SM3 digest of the electronic document. The pre-archived information package generation module 104 is further configured to encapsulate the metadata and the electronic document into a pre-archived information package and name the pre-archived information package according to the identification code. Specifically, according to the encapsulation specifications and single-set archiving requirements, the cleaned metadata and the corresponding electronic document are uniquely identified, hash-bound, and structurally encapsulated to generate a standard pre-archived information package. The identification code is a globally unique identifier, such as a combination of year and business serial number, ensuring the traceability of the archives. Encapsulation makes the dispersed metadata and electronic document form an inseparable organic whole, meeting the requirements of long-term archiving and legal validity.

[0034] In one embodiment, the pre-archived information package push module 105 is further configured to push the pre-archived information package to the archive system based on a pre-set push path. Specifically, through an encrypted transmission channel, the pre-packaged pre-archived information package is pushed to the archive system in real time according to the preset push path, and a receipt is received, achieving a seamless connection from pre-archiving to formal archiving. This realizes a closed-loop process between the business system and the archive system, avoiding delays or errors caused by manual intervention.

[0035] like Figure 1 As shown, if archiving fails, the system returns to the pre-archiving device for re-archiving. If pre-archiving fails, the system returns to the source system for re-pushing.

[0036] like Figure 1 As shown, the pre-archiving device also includes a business configuration module 106, used to configure parameters for the data receiving module 101, the four-property detection module 102, the metadata cleaning module 103, the pre-archiving information package generation module 104, and the pre-archiving information package push module 105. Specifically, the pre-archiving device provides a centralized visual business configuration module 106, which implements full parameterized management of metadata models (such as custom fields), file access methods, four-property detection rules (such as adding "watermark verification"), data cleaning mapping (such as visual drag-and-drop configuration), encapsulation templates (such as custom XML structures), push strategies (such as timed / triggered, interface paths, interface parameters, push range, etc.), scheduling plans (such as timed tasks such as data collection, user updates, and periodic push messages), monitoring indicators, and data dictionaries (such as the number of consecutive data failures, failure ratio configuration alarm thresholds, etc.). Business expansion or rule adjustments can take effect without coding, and it has version control, gray release (such as pilot release before full release), and hierarchical permission functions (such as administrators can modify rules, while operators can only view them), ensuring that configuration changes are traceable, rollbackable, and executed in a controlled manner. When a new business function is added, only the metadata model and detection rules need to be added in the business configuration module. No modification to the pre-archiving device code is required, enabling rapid response to business expansion. In this application, a pre-archiving device exists between the archive system and the source system. When a new type of business data is added, there is no need to synchronously modify the interfaces and packaging logic on both the source system and the archive system. Only business configuration needs to be performed in the pre-archiving device, resulting in a short development cycle and strong scalability.

[0037] This invention provides an electronic archive pre-archiving device. By setting up the pre-archiving device, archive data is received from the source system. During the pre-archiving process, the four properties of the archive data are detected, metadata is cleaned, information packets are encapsulated, and push operations are performed in advance and standardized. This achieves zero-intrusion aggregation of heterogeneous data and interception of problematic data before it is put into the database. This reduces implementation and maintenance costs, improves archiving efficiency and data accuracy, saves paper consumables, and realizes paperless archiving of electronic documents in a single set.

[0038] This application also provides a method for pre-archiving electronic documents, which corresponds one-to-one with the electronic document pre-archiving device described in the above embodiments. The method can be applied to, for example... Figure 2 In this application environment, the device communicates with the server via a network. The server can receive metadata and electronic files pushed by the source system through the device, with each metadata and electronic file configured in a one-to-one correspondence. Based on a pre-set four-property detection model, the server performs four-property checks on the metadata and electronic files. Based on a pre-set data cleaning model, the server cleans the metadata after the four-property checks. Based on a pre-set pre-archived information package model, the server encapsulates the cleaned metadata and electronic files into a pre-archived information package. Based on a pre-set push model, the server pushes the pre-archived information package to the archive system.

[0039] The device side can be, but is not limited to, various personal computers, laptops, smartphones, tablets, and portable wearable devices. The server side can be implemented using a standalone server or a server cluster consisting of multiple servers. The invention will now be described in detail through specific embodiments.

[0040] Please see Figure 3 As shown, Figure 3 A flowchart illustrating the electronic archive pre-archiving method provided in this embodiment of the invention includes the following steps: S1: Receive metadata and electronic files pushed by the source system, and set the metadata and electronic files to correspond one-to-one; S2: Based on a pre-set four-property detection model, perform four-property detection on the metadata and the electronic document; S3: Based on a pre-set data cleaning model, perform data cleaning on the metadata after the four properties detection; S4: Based on the pre-set pre-archived information package model, the metadata and electronic files after data cleaning are packaged into a pre-archived information package; S5: Based on the pre-set push model, push the pre-archived information package to the archive system.

[0041] Specifically, in step S1, the metadata and the electronic file are received in parallel. The metadata includes the source-side SM3 digest of the metadata and the source-side SM3 digest of the electronic file.

[0042] Specifically, step S2 includes: determining the source-side SM3 digest of the metadata, the source-side SM3 digest of the electronic file, the source-side size of the electronic file, the source-side sending timestamp, the platform-side SM3 digest of the metadata, the platform-side SM3 digest of the electronic file, the platform-side size of the electronic file, and the platform-side receiving timestamp based on the metadata and the electronic file; The source-side SM3 digest of the metadata is compared with the platform-side SM3 digest of the metadata; the source-side SM3 digest of the electronic file is compared with the platform-side SM3 digest of the electronic file; the source-side size of the electronic file is compared with the platform-side size of the electronic file; and the source-side sending timestamp is compared with the platform-side receiving timestamp. Based on the comparison results, a first layer of verification is performed on the metadata and its corresponding electronic file. The first layer of verification includes authenticity and integrity verification. Based on a pre-set file parsing tool, the electronic file is parsed, and a second verification is performed on the electronic file based on the parsing results. The second verification includes availability verification. Based on a pre-set security scanning tool, a third layer of verification is performed on the metadata and its corresponding electronic files, including a security verification.

[0043] Specifically, step S2 includes: when any one of the first verification, the second verification, and the third verification fails, the verification is determined to have failed and a test report is generated based on a preset report template; when all three verifications of the first verification, the second verification, and the third verification pass, the verification is determined to have passed.

[0044] Specifically, step S3 includes: based on the differences in metadata format and field standards of the source system, performing unified cleaning, conversion and completion according to the metadata specifications of the archive categories.

[0045] Specifically, step S4 includes: generating an identifier code for the cleaned metadata and the electronic file; constructing a mapping relationship between the SM3 digest of the metadata and the SM3 digest of the electronic file, and storing the SM3 digest of the metadata and the SM3 digest of the electronic file together; encapsulating the metadata and the electronic file into a pre-archived information package, and naming the pre-archived information package according to the identifier code.

[0046] Specifically, step S5 includes: pushing the pre-archived information package to the archive system based on a pre-set push path.

[0047] Specifically, the electronic archive pre-archiving method also includes configuring parameters for the data receiving module, the four-property detection module, the metadata cleaning module, the pre-archiving information package generation module, and the pre-archiving information package push module through the business configuration module.

[0048] As can be seen, in the above solution, this application receives archive data from the source system by setting up a pre-archiving device. During the pre-archiving process, the four properties of the archive data are checked, metadata is cleaned, information packages are encapsulated, and push operations are performed in advance and standardized. This achieves zero-intrusion aggregation of heterogeneous data and interception of problematic data before it is put into the database. This reduces implementation and maintenance costs, improves archiving efficiency and data accuracy, saves paper consumables, and realizes paperless archiving of electronic documents in a single set.

[0049] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0050] Specific limitations regarding the electronic document pre-archiving device can be found in the limitations of the electronic document pre-archiving method described above, and will not be repeated here. Each module in the aforementioned electronic document pre-archiving device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device in hardware form, or stored in the memory of a computer device in software form, so that the processor can call and execute the corresponding operations of each module.

[0051] In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 4 As shown, the computer device includes a processor, memory, network interface, and database connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile and / or volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface is used for communication with external devices via a network connection. When the computer program is executed by the processor, it implements the functions or steps of an electronic document pre-archiving method on the server side.

[0052] In one embodiment, a computer device is provided, which may be a device terminal, and its internal structure diagram may be as follows: Figure 5As shown, the computer device includes a processor, memory, network interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface is used to communicate with an external server via a network connection. When the computer program is executed by the processor, it implements the functions or steps of an electronic document pre-archiving method on the device side.

[0053] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to perform the following steps: Receive metadata and electronic files pushed by the source system, and set a one-to-one correspondence between the metadata and the electronic files; Based on a pre-set four-property detection model, the metadata and the electronic document are subjected to four-property detection. Based on a pre-set data cleaning model, the metadata after the four properties detection is cleaned. Based on a pre-set pre-archived information package model, the metadata and electronic files after data cleaning are encapsulated into a pre-archived information package; Based on a pre-set push model, the pre-archived information package is pushed to the archive system.

[0054] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program performing the following steps when executed by a processor: Receive metadata and electronic files pushed by the source system, and set a one-to-one correspondence between the metadata and the electronic files; Based on a pre-set four-property detection model, the metadata and the electronic document are subjected to four-property detection. Based on a pre-set data cleaning model, the metadata after the four properties detection is cleaned. Based on a pre-set pre-archived information package model, the metadata and electronic files after data cleaning are encapsulated into a pre-archived information package; Based on a pre-set push model, the pre-archived information package is pushed to the archive system.

[0055] It should be noted that the functions or steps that can be implemented by the computer-readable storage medium or computer device described above can be referred to the relevant descriptions on the server side and device side in the foregoing method embodiments. To avoid repetition, they will not be described one by one here.

[0056] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0057] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is used as an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0058] The above-described embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included within the protection scope of the present invention.

Claims

1. An electronic archive pre-archiving device, characterized in that, include: The data receiving module is used to receive metadata and electronic files pushed by the source system, and the metadata and electronic files are set to correspond one-to-one. The four-property detection module is used to perform four-property detection on the metadata and the electronic document based on a pre-set four-property detection model; The metadata cleaning module is used to clean the metadata after the four properties detection based on a pre-set data cleaning model. A pre-archived information package generation module is used to encapsulate the cleaned metadata and the electronic files into a pre-archived information package based on a pre-set pre-archived information package model. The pre-archived information package push module pushes the pre-archived information package to the archive system based on a pre-set push model.

2. The electronic archive pre-archiving device according to claim 1, characterized in that, The data receiving module is also used to receive the metadata and the electronic file in parallel, wherein the metadata includes the source-side SM3 digest of the metadata and the source-side SM3 digest of the electronic file.

3. The electronic archive pre-archiving device according to claim 1, characterized in that, The four-property detection module is also used to determine the source-side SM3 digest of the metadata, the source-side SM3 digest of the electronic file, the source-side size of the electronic file, the source-side sending timestamp, the platform-side SM3 digest of the metadata, the platform-side SM3 digest of the electronic file, the platform-side size of the electronic file, and the platform-side receiving timestamp based on the metadata and the electronic file. The four-property detection module is also used to compare the source-side SM3 digest of the metadata with the platform-side SM3 digest of the metadata, compare the source-side SM3 digest of the electronic file with the platform-side SM3 digest of the electronic file, compare the source-side size of the electronic file with the platform-side size of the electronic file, and compare the source-side sending timestamp with the platform-side receiving timestamp. Based on the comparison results, a first-level verification is performed on the metadata and its corresponding electronic file. The first-level verification includes authenticity and integrity verification. The four-property detection module is also used to parse electronic files based on a pre-set file parsing tool, and to perform a second verification on the electronic files based on the parsing results. The second verification includes availability verification. The four-property detection module is also used to perform a third layer of verification on the metadata and its corresponding electronic files based on a pre-set security scanning tool. The third layer of verification includes security verification.

4. The electronic archive pre-archiving device according to claim 3, characterized in that, The four-property detection module is also used to determine that the verification has failed and generate a detection report based on a preset report template when any one of the first verification, the second verification and the third verification fails. The four-property detection module is also used to determine that the verification is passed when all three verifications in the first verification, the second verification, and the third verification are passed.

5. The electronic archive pre-archiving device according to claim 1, characterized in that, The module for generating pre-archived information packages is also used to generate identification codes for the metadata and electronic documents after data cleaning. The module for generating pre-archived information packages is also used to construct a mapping relationship between the SM3 digest of the metadata and the SM3 digest of the electronic file, and to store the SM3 digest of the metadata and the SM3 digest of the electronic file together. The module for generating pre-archived information packages is further configured to encapsulate the metadata and the electronic files into a pre-archived information package, and name the pre-archived information package according to the identification code.

6. The electronic archive pre-archiving device according to claim 1, characterized in that, The pre-archived information package push module is also used to push the pre-archived information package to the archive system based on a pre-set push path.

7. The electronic archive pre-archiving device according to claim 1, characterized in that, It also includes a business configuration module, which is used to configure parameters for the data receiving module, the four-property detection module, the metadata cleaning module, the pre-archived information package generation module, and the pre-archived information package push module.

8. A method for pre-archiving electronic records, characterized in that, include: Receive metadata and electronic files pushed by the source system, and set a one-to-one correspondence between the metadata and the electronic files; Based on a pre-set four-property detection model, the metadata and the electronic document are subjected to four-property detection. Based on a pre-set data cleaning model, the metadata after the four properties detection is cleaned. Based on a pre-set pre-archived information package model, the metadata and electronic files after data cleaning are encapsulated into a pre-archived information package; Based on a pre-set push model, the pre-archived information package is pushed to the archive system.

9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the electronic archive pre-archiving method as described in claim 7.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the electronic archive pre-archiving method as described in claim 7.

Images