System data exporting method and device with file and picture packaging function

Abstract

The invention relates to the technical field of data processing, and particularly provides a system data exporting method and device with a file and picture packaging function, and the method comprises the following steps: S1, receiving a data exporting request of a user in a system, and determining to-be-exported data; s2, creating a packaging module, distributing a storage space for the to-be-exported data, establishing a data index, and recording a storage position of each to-be-exported data in the packaging module; s3, integrating the screened file data and picture data into a packaging module according to a preset format and sequence, and respectively storing the file data and the picture data in different subdirectories for integrity verification; s4, performing compression processing on the integrated packaging module to generate a compressed file package; and S5, exporting the generated compressed file package to a storage path specified by a user or transmitting the compressed file package to a specified receiving end. Compared with the prior art, the problems that in the prior art, manual file and picture arrangement is tedious in operation and prone to errors can be solved.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and specifically provides a system data export method and device with file and picture packaging functions. Background Art

[0002] In the existing departmental business management system, although the system connections between departments are being actively opened up, there are still some barriers, such as the inability to connect directly to the network, the data information is relatively private and not suitable for transmission on the network, etc. It is usually necessary to export the data in various forms for further analysis and processing.

[0003] In the prior art, the data processing methods for files and pictures are relatively simple, usually requiring manual organization of files and pictures, as well as naming and packaging, which is cumbersome and error-prone. Especially when a large number of files and pictures need to be matched with specific identifiers, the workload is huge. Currently, there is a lack of an efficient solution that can automatically associate files and pictures in the system with data in Excel tables and generate corresponding compressed packages. Summary of the invention

[0004] The present invention aims at solving the above-mentioned deficiencies of the prior art and provides a highly practical system data export method with file and picture packaging function.

[0005] A further technical task of the present invention is to provide a system data export device with a file and picture packaging function that is reasonably designed, safe and applicable.

[0006] The technical solution adopted by the present invention to solve its technical problem is: A system data export method with file and picture packaging function has the following steps: S1, data screening, receiving the user's data export request in the system, screening the file data and image data in the system according to the preset screening conditions, and determining the data to be exported; S2, packaging preparation, creating a packaging module, allocating storage space for the data to be exported, and establishing a data index, the data index records the storage location of each data to be exported in the packaging module; S3, data integration, integrating the screened file data and image data into the packaging module according to a predetermined format and sequence, wherein the file data and image data are respectively stored in different subdirectories, and integrity verification is performed on the file data and image data during the integration process; S4, compression and packaging, compressing the integrated packaging modules to generate a compressed file package, wherein the format of the compressed file package is a universal compression format; S5. Export the generated compressed file package to a storage path specified by the user or transmit it to a specified receiving end.

[0007] Furthermore, in step S1, it specifically includes: S1-1, Request acceptance: the system opens a dedicated data export request listening port or service interface, and continuously waits for the user to trigger the data export operation instruction in the system operation interface and submit the corresponding request information. Once a data export request is detected, the data screening process is immediately started; S1-2, filter condition loading, reading the set filter conditions from the system pre-configured database or configuration file; S1-3, data traversal and screening, the system begins to comprehensively traverse all business data and file data stored in the database, and compares each attribute of each file or image with the loaded screening conditions one by one. Only when the file or image meets all the screening conditions will it be marked as data to be exported and its related metadata information will be recorded.

[0008] Furthermore, in step S2, it specifically includes: S2-1, construction of a packaging module, opening up a special area in the system memory for constructing the packaging module, the packaging module is a logical container for organizing and managing the data to be exported, and at the same time, creating a corresponding physical folder in the local hard disk or the designated storage area as the basic directory for actually storing the data to be exported; S2-2, storage space allocation; S2-3. Data index is established.

[0009] Furthermore, in step S2-2, based on the estimated total amount of data to be exported and the currently available storage space of the system, sufficient storage space is allocated to the packaging module on the physical storage medium, which includes reserving a certain proportion of additional space to cope with possible fluctuations in data volume or temporary data storage needs.

[0010] Furthermore, in step S2-3, a data index field is created to record the storage location information of each data to be exported in the packaging module. For each data to be exported, its file name, file path, relative storage path in the packaging module and corresponding physical storage address are recorded in detail in the data index.

[0011] Furthermore, in step S3, it specifically includes: S3-1, determining the format and sequence, reading the integration format and sequence information of the predetermined file data and image data from the system configuration file or the preset integration rule, and determining the names and path structures of different subdirectories in which the file data and image data are stored in the packaging module; S3-2, data transfer and storage, according to the data index, read the filtered file data and image data from the original storage location and transfer them to the corresponding subdirectory of the packaging module; During the transfer process, the file data is renamed and stored according to the predetermined format and sequence; For image data, store them in the specified order; S3-3, integrity check execution. After each file data or image data is transferred to the packaging module, the integrity check program is immediately started. For the file data, check whether its file header information is complete, whether the file size is consistent with the original data, and whether there is any data loss or damage. If any data integrity problem is found during the verification process, the error information is immediately recorded and the data is marked as abnormal data.

[0012] Furthermore, in step S4, it specifically includes: (1) Compression algorithm selection: select a suitable compression algorithm based on the characteristics of the data to be compressed and the user's preset preferences; (2) Compression processing is performed, using the selected compression algorithm to compress the entire packaging module, including compressing all the contents of the file data subdirectory and the image data subdirectory in the packaging module.

[0013] Furthermore, in step S5, it specifically includes: S5-1, storage path or receiving end confirmation, read the storage path information specified by the user in the data export request, check whether the path exists and has write permission, if the path exists and has write permission, export the data; S5-2, data transmission and storage, copy the generated compressed file package directly from the system temporary storage location to the specified local folder according to the confirmed storage path; after the transmission is completed, check whether the compressed file package is completely stored in the specified location, and record detailed log information of the export operation.

[0014] A system data export device with file and picture packaging function, comprising: at least one memory and at least one processor; The at least one memory is used to store a machine-readable program; The at least one processor is used to call the machine-readable program to execute a system data export method with file and image packaging functions.

[0015] Compared with the prior art, the system data export method and device with file and picture packaging function of the present invention has the following outstanding beneficial effects: In the present invention, users do not need to perform compression and naming operations manually, which saves a lot of time and energy and improves work efficiency. The compressed package can be automatically named to avoid errors that may occur in manual input and improve the accuracy of data. Users only need to perform the export operation, and the system can automatically complete the subsequent compression and naming process, which is simple and easy to operate. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Attached Figure 1 The invention is a flowchart of a system data export method with file and picture packaging function. DETAILED DESCRIPTION

[0018] In order to enable those skilled in the art to better understand the solution of the present invention, the present invention is further described in detail below in conjunction with specific implementation methods. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0019] A best embodiment is given below: like Figure 1 As shown, a system data export method with file and picture packaging function in this embodiment has the following steps: S1, data screening, receiving the user's data export request in the system, screening the file data and image data in the system according to the preset screening conditions, and determining the data to be exported; Specifically include: S1-1. Request reception: The system opens a dedicated data export request listening port or service interface, and continuously waits for the user to trigger the data export operation instruction in the system operation interface and submit the corresponding request information. Once a data export request is detected, the data screening process is immediately started.

[0020] S1-2, filter condition loading: read the set filter conditions from the system pre-configured database or configuration file. These filter conditions may include multi-dimensional restrictions such as name, business type, creation time interval, classification identification, etc.

[0021] S1-3, Data traversal and screening: The system begins to traverse all business data and file data stored in the database. For each file or picture, its attributes are compared with the loaded screening conditions one by one.

[0022] For example, for the file type, check whether its extension matches the specified type in the filter condition; for the creation time, determine whether it is within the set time range.

[0023] Only when a file or image meets all the filtering conditions will it be marked as data to be exported, and its related metadata information, such as file name, file path, file size, creation time, etc., will be recorded for subsequent processing.

[0024] S2, packaging preparation, creating a packaging module, allocating storage space for the data to be exported, and establishing a data index, the data index records the storage location of each data to be exported in the packaging module; Specifically include: S2-1. Packaging module construction: A dedicated area is opened in the system memory to build the packaging module. This packaging module can be regarded as a logical container for organizing and managing the data to be exported. At the same time, a corresponding physical folder is created in the local hard disk or the specified storage area as the basic directory for actually storing the data to be exported.

[0025] S2-2, storage space allocation: Based on the estimated total amount of data to be exported and the current available storage space in the system, sufficient storage space is allocated on the physical storage medium for the packaging module. This includes reserving a certain percentage of additional space to cope with possible fluctuations in data volume or temporary data storage needs.

[0026] For example, if the total estimated amount of data to be exported is 200MB, the system may allocate 256MB of storage space to the packaging module to ensure that the data can be stored smoothly without interruption due to insufficient space.

[0027] S2-3, data index establishment: create a data index field to record the storage location information of each data to be exported in the packaging module. For each data to be exported, its file name, file path, relative storage path in the packaging module and corresponding physical storage address are recorded in detail in the data index.

[0028] For example, for a picture named "document.png", its relative path in the packaging module is recorded as " / images / document.png", and the corresponding physical storage address is "D:\export\packaging\images\document.png", so that the data can be quickly located and accessed during subsequent data integration, compression and export processes.

[0029] S3, data integration, integrating the screened file data and image data into the packaging module according to a predetermined format and sequence, wherein the file data and image data are respectively stored in different subdirectories, and integrity verification is performed on the file data and image data during the integration process; Specifically include: S3-1. Format and sequence determination: Reading the integration format and sequence information of the predetermined file data and image data from the system configuration file or the preset integration rule.

[0030] For example, it is specified that file data is arranged in alphabetical order and image data is arranged in reverse order of creation time.

[0031] At the same time, determine the different subdirectory names and path structures where file data and image data are stored in the packaging module, such as " / files" for storing file data and " / images" for storing image data.

[0032] S3-2, data transfer and storage: According to the data index, the filtered file data and image data are read from the original storage location and transferred to the corresponding subdirectory of the packaging module.

[0033] During the transfer process, the file data is renamed and stored in a predetermined format and order to ensure the uniqueness and standardization of the file name; Image data is also stored in the specified order.

[0034] S3-2, integrity check execution: After each file data or image data is transferred to the packaging module, the integrity check program is immediately started. For file data, check whether its file header information is complete, whether the file size is consistent with the original data, and whether there is any data loss or damage; If any data integrity issues are found during the verification process, the error information is recorded immediately and the data is marked as abnormal data for subsequent processing.

[0035] S4, compression and packaging, compressing the integrated packaging module to generate a compressed file package, the format of the compressed file package is a universal compression format, so as to facilitate transmission and storage on different operating systems and devices; include: (1) Compression algorithm selection: Select a suitable compression algorithm from the various general compression algorithm libraries supported by the system based on the characteristics of the data to be compressed and the user's preset preferences (such as compression speed, compression ratio requirements, etc.).

[0036] For example, if the data to be compressed is mainly text files and the compression speed requirement is high, you can choose the LZ77 algorithm; if the compression ratio requirement is high and the data type is more complex, you can choose the ZIP algorithm or the 7z algorithm.

[0037] (2) Compression processing execution: Use the selected compression algorithm to compress the entire packaging module, including compressing all contents such as the file data subdirectory and the image data subdirectory in the packaging module.

[0038] S5. Export the generated compressed file package to a storage path specified by the user or transmit it to a specified receiving end; Specifically include: S5-1, storage path or receiving end confirmation: read the storage path information specified by the user in the data export request, check whether the path exists and has write permission, and if the path exists and has write permission, export the data; S5-2, data transmission and storage: the generated compressed file package is directly copied from the system temporary storage location to the designated local folder according to the confirmed storage path; After the transfer is completed, check whether the compressed file package is completely stored in the specified location, and record detailed log information of the export operation, including export time, export file package name, target storage path or receiving end, etc., for subsequent query and audit.

[0039] Based on the above method, a system data export device with file and picture packaging function in this embodiment includes: at least one memory and at least one processor; The at least one memory is used to store a machine-readable program; The at least one processor is used to call the machine-readable program to execute a system data export method with file and image packaging functions.

[0040] The above-mentioned specific implementations are only specific cases of the present invention. The patent protection scope of the present invention includes but is not limited to the above-mentioned specific implementations. Any technical solutions that conform to the above-mentioned specific implementations of the present invention and any appropriate changes or substitutions made by ordinary technicians in the relevant technical field shall fall within the patent protection scope of the present invention.

[0041] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A system data export method with file and picture packaging function, characterized in that: The steps are as follows: S1, data screening, receiving the user's data export request in the system, screening the file data and image data in the system according to the preset screening conditions, and determining the data to be exported; S2, packaging preparation, creating a packaging module, allocating storage space for the data to be exported, and establishing a data index, the data index records the storage location of each data to be exported in the packaging module; S3, data integration, integrating the screened file data and image data into the packaging module according to a predetermined format and sequence, wherein the file data and image data are respectively stored in different subdirectories, and integrity verification is performed on the file data and image data during the integration process; S4, compression and packaging, compressing the integrated packaging modules to generate a compressed file package, wherein the format of the compressed file package is a universal compression format; S5. Export the generated compressed file package to a storage path specified by the user or transmit it to a specified receiving end.

2. A system data export method with file and picture packaging function according to claim 1, characterized in that: In step S1, it specifically includes: S1-1, Request acceptance: the system opens a dedicated data export request listening port or service interface, and continuously waits for the user to trigger the data export operation instruction in the system operation interface and submit the corresponding request information. Once a data export request is detected, the data screening process is immediately started; S1-2, filter condition loading, reading the set filter conditions from the system pre-configured database or configuration file; S1-3, data traversal and screening, the system begins to comprehensively traverse all business data and file data stored in the database, and compares each attribute of each file or image with the loaded screening conditions one by one. Only when the file or image meets all the screening conditions will it be marked as data to be exported and its related metadata information will be recorded.

3. A system data export method with file and picture packaging function according to claim 2, characterized in that: In step S2, it specifically includes: S2-1, construction of a packaging module, opening up a special area in the system memory for constructing the packaging module, the packaging module is a logical container for organizing and managing the data to be exported, and at the same time, creating a corresponding physical folder in the local hard disk or the designated storage area as the basic directory for actually storing the data to be exported; S2-2, storage space allocation; S2-3. Data index is established.

4. A system data export method with file and picture packaging function according to claim 3, characterized in that: In step S2-2, based on the estimated total amount of data to be exported and the currently available storage space of the system, sufficient storage space is allocated on the physical storage medium for the packaging module, including reserving a certain proportion of additional space to cope with possible fluctuations in data volume or temporary data storage needs.

5. A system data export method with file and picture packaging function according to claim 4, characterized in that: In step S2-3, a data index field is created to record the storage location information of each data to be exported in the packaging module. For each data to be exported, its file name, file path, relative storage path in the packaging module and corresponding physical storage address are recorded in detail in the data index.

6. A system data export method with file and picture packaging function according to claim 5, characterized in that: In step S3, it specifically includes: S3-1, determining the format and sequence, reading the integration format and sequence information of the predetermined file data and image data from the system configuration file or the preset integration rule, and determining the names and path structures of different subdirectories in which the file data and image data are stored in the packaging module; S3-2, data transfer and storage, according to the data index, read the filtered file data and image data from the original storage location and transfer them to the corresponding subdirectory of the packaging module; During the transfer process, the file data is renamed and stored according to the predetermined format and sequence; For image data, store them in the specified order; S3-3, integrity check execution. After each file data or image data is transferred to the packaging module, the integrity check program is immediately started. For the file data, check whether its file header information is complete, whether the file size is consistent with the original data, and whether there is any data loss or damage. If any data integrity problem is found during the verification process, the error information is immediately recorded and the data is marked as abnormal data.

7. A system data export method with file and picture packaging function according to claim 6, characterized in that: In step S4, it specifically includes: (1) Compression algorithm selection: select a suitable compression algorithm based on the characteristics of the data to be compressed and the user's preset preferences; (2) Compression processing is performed, using the selected compression algorithm to compress the entire packaging module, including compressing all the contents of the file data subdirectory and the image data subdirectory in the packaging module.

8. A system data export method with file and picture packaging function according to claim 7, characterized in that: In step S5, it specifically includes: S5-1, storage path or receiving end confirmation, read the storage path information specified by the user in the data export request, check whether the path exists and has write permission, if the path exists and has write permission, export the data; S5-2, data transmission and storage, copy the generated compressed file package directly from the system temporary storage location to the specified local folder according to the confirmed storage path; after the transmission is completed, check whether the compressed file package is completely stored in the specified location, and record detailed log information of the export operation.

9. A system data export device with file and picture packaging function, characterized in that: include: at least one memory and at least one processor; The at least one memory is used to store a machine-readable program; The at least one processor is configured to call the machine-readable program to execute the method according to any one of claims 1 to 8.

Images