A blockchain-based archive storage system

Abstract

The present invention relates to the field of information technology, and in particular to a file storage system based on blockchain, including a file receiving module, a file storage module, a file scheduling module, a file storage module and a file compression storage module, wherein the file receiving module receives files and file descriptions, and the files are scanned copies of electronic files or paper files, the file storage module extracts the hash value of the files and uploads them to blockchain storage, the file scheduling module establishes a file index table, and the file compression storage module periodically checks the number of files under each file type, determines the percentage of duplicate content in the files, and if the percentage of duplicate content exceeds a preset threshold, establishes a common template, and represents the files as a superposition of the common template and unique content. The substantial effect of the present invention is: to realize the trusted sharing of files between departments, a large amount of storage space can be saved, and financial expenditure can be reduced.

Description

Technical Field

[0001] The present invention relates to the field of information technology, and in particular to an archive storage system based on blockchain. Background Art

[0002] When the government departments in the field of people's livelihood serve the people, a large number of archives will be generated. After the matters are handled, these archives still need to be archived for backup or reference. Although with the promotion of electronic office in recent years, some service archives have been digitized. However, when it comes to matters with high security requirements such as funds and identity authentication, paper documents are still needed. As a result, archives need to prepare corresponding areas every year to store new paper archives, and the new paper archives need to be digitized. A large amount of electronic data brings dual pressures of capacity and response efficiency to the storage system of archives. Even if the archives have completed the digitization and storage of archives, it is still difficult for relevant departments to directly retrieve archives from the archives when handling matters for the people. The people who handle matters need to go to the relevant departments to issue new certificates, etc., to handle new matters, which is not only inconvenient for the people to handle matters, but also adds new archives. To this end, it is necessary to study archive storage technology that can be trusted and shared between departments and reduce storage costs. Summary of the invention

[0003] The technical problem to be solved by the present invention is that it is difficult to share livelihood archives between departments in a reliable manner, which leads to low efficiency in handling matters by the masses. A blockchain-based archive storage system is proposed, which uses blockchain to provide reliable proof, so that archives can be reliably transferred between departments, without the need for the masses to provide them separately multiple times, thereby improving the efficiency of handling matters.

[0004] In order to solve the above technical problems, the technical solution adopted by the present invention is: a blockchain-based archive storage system, including an archive receiving module, an archive evidence module, an archive scheduling module, an archive storage module and an archive compression storage module, the archive receiving module receives archives and archive descriptions, the archives are scanned copies of electronic archives or paper archives, the archive descriptions record the archive type and the search field value, the archive evidence module extracts the hash value of the archive and uploads it to the blockchain for storage, the archive scheduling module stores the archive in the archive storage module, and establishes an archive index table, the archive index table records the archive identifier, hash value, archive type, search field value, archive storage time , archive description and archive storage address, the archive compression storage module periodically checks the number of archives under each archive type, and when the number of archives of the same type reaches a preset threshold, determines the percentage of duplicate content in the archives, and if the percentage of duplicate content exceeds the preset threshold, establishes a common template, represents the archive as a superposition of the common template and the unique content, associates the unique content of the archive with the common template identifier and the archive identifier, and moves it from the archive storage module to the archive compression storage module. When requesting to read the archive from the archive scheduling module, the archive compression storage module reads the unique content and the common template, superimposes the unique content and the common template to restore the archive, verifies the hash value of the archive, and submits it to the requester.

[0005] Preferably, when establishing a common template for electronic archives, the archive compression storage module performs the following steps: extracting the value of each field of a preset number of electronic archives; exhaustively enumerating field combinations, counting the number of value types of the field combination for the preset number of electronic archives, and calculating the total number of value types of the field combination; if the ratio of the number of value types to the total number of value types is lower than a preset threshold, the field combination is listed as an alternative field combination; the field combination with the most fields included in the alternative field combination is the final common field combination; storing the field composition of the final common field combination, assigning a combination value number to each value of the field combination for the preset number of electronic archives; the final common field combination and the combination value number constitute a common template; when a new electronic archive of the same type is received, selecting the closest combination value number for the value of the common field combination, and the value that does not correspond to the selected combination value number is retained; the retained values ​​of the common field combination and the field values ​​of the non-common field combination are used as unique content.

[0006] Preferably, when establishing a common template for scans, the archive compression storage module performs the following steps: reading a preset number of scans to form a sample set; counting the mean of each pixel in the sample set scans; obtaining a common pixel set, at the pixels in the common pixel set, the difference between the pixel value of the scans in the sample set and the pixel mean is lower than a preset threshold; establishing a blank scan, setting the pixels recorded in the common pixel set as the pixel mean to form a common template; dividing the scan area into a number of rectangular areas and numbering each rectangular area; calculating the difference in the pixel value at the same position between the scan and the common template in each rectangular area, and if there is a non-zero difference in the rectangular area, storing the difference associated with the rectangular area number; the difference of all rectangular areas and the associated rectangular area numbers constitute unique content.

[0007] Preferably, when the file receiving module receives a new scan of the same type, it fine-tunes the pixel value of the scan within a preset range so that the scan has the largest number of pixels that are identical to the common template. After confirmation by the scanner, the file receiving module receives the adjusted scan. If the scanner does not confirm, the file receiving module receives the scan before adjustment.

[0008] Preferably, the method for fine-tuning the pixel value of a scan within a preset range includes: calculating the difference between each pixel value of the scan and a common template, and if the absolute value of the difference is less than a preset threshold, setting the corresponding pixel value to be the same as the common template; extracting the boundary of the scan before adjustment, and the boundary of the scan after adjustment, wherein the boundary is a set of pixels whose pixel value has a difference with an adjacent pixel value greater than a preset threshold; if the boundary has not changed, the adjustment is completed; if the boundary has changed, the pixels near the changed boundary are restored to the pixel values ​​before adjustment, and the adjustment is completed.

[0009] Preferably, the archive scheduling module records multiple types of archive reading requests with the same search field value within a short period of time, and the short period of time is a preset time length. If the number of times that multiple types of archives are requested to be read within a short period of time exceeds a preset threshold, an archive association reading table is established to record the types of archives requested to be read within a short period of time. If an archive type in the archive association reading table is read, archives with the same search field value under other archive types in the archive association reading table are restored from the archive area to the storage area.

[0010] The substantial effects of the present invention are as follows: by using the archive evidence module to realize proof of archive authenticity with the help of blockchain, the authenticity of archives can be verified between different departments, thereby providing real archive materials for handling related matters and realizing trusted sharing of archives between departments; by establishing an archive index table through the archive scheduling module, the relevant archives of the masses can be conveniently and quickly queried, thereby improving the efficiency of archive retrieval; by using the archive compression storage module, the storage space occupied by electronic archives and scanned copies can be compressed, saving storage space overhead, and for infrequently used formatted archives that need to be stored for a long time, a large amount of storage space can be saved, thereby reducing financial expenses. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 Schematic diagram of the archive storage system of Example 1.

[0012] Figure 2 This is a schematic diagram of establishing a common template for electronic archives in Example 1.

[0013] Figure 3 A schematic diagram of establishing a common template for scanned documents in Example 1.

[0014] Figure 4 This is a schematic diagram of fine-tuning the pixel value of a scanned document within a preset range in Example 2.

[0015] Among them: 10. Archive receiving module, 20. Archive notarization module, 30. Archive scheduling module, 31. Read archive request, 40. Archive storage module, 50. Archive compression storage module, 60. Blockchain. DETAILED DESCRIPTION

[0016] The specific implementation of the present invention will be further described below through specific examples in conjunction with the accompanying drawings.

[0017] Embodiment 1:

[0018] A blockchain-based archive storage system, see Attachment Figure 1, including an archive receiving module 10, an archive evidence module 20, an archive scheduling module 30, an archive storage module 40 and an archive compression storage module 50. The archive receiving module 10 receives archives and archive descriptions. The archives are scanned copies of electronic archives or paper archives. The archive description records the archive type and the search field value. The archive description is added by the staff to indicate the archive type, source, generation time and function, etc. The archive evidence module 20 extracts the hash value of the archive and uploads it to the blockchain 60 for storage. The archive scheduling module 30 stores the archive in the archive storage module 40 and establishes an archive index table. The archive index table records the archive identifier, hash value, archive type, search field value, archive storage time, archive description and archive storage address. The archive compression storage module 50 periodically checks the archive type under each file type. When the number of files of the same type reaches a preset threshold, the percentage of duplicate content in the file is determined. If the percentage of duplicate content exceeds the preset threshold, a common template is established, and the file is represented as a superposition of the common template and the unique content. After associating the unique content of the file with the common template identifier and the file identifier, it is moved from the file storage module 40 to the file compression storage module 50. The file retrieval module 30 is responsible for receiving the file reading request 31, which is used to share files between departments, such as sharing qualification certificates, so that the masses only need to provide qualification certificates once to handle multiple affairs. When requesting to read the file from the file scheduling module 30, the file compression storage module 50 reads the unique content and the common template, superimposes the unique content and the common template to restore the file, and verifies the hash value of the file and submits it to the requester. In the department that handles specific administrative matters for the masses, it is necessary to receive a large number of paper application forms and qualification certificates of the same type and with formatted features. After completing the handling of the matter, this type of paper application form cannot be destroyed immediately, but needs to be transported to the archives for archiving and electronic storage. For some important certification documents, the originals need to be kept for a preset period of time before they can be destroyed. With the promotion of electronic office in recent years, some forms and qualification certification documents are in electronic format and can be directly stored. However, the storage space required for a large number of forms and qualification certification documents is very large. This embodiment uses the archive compression storage module 50 to compress and store archives that have a long interval between reuses, saving storage space expenses.

[0019] Please see attached Figure 2When establishing a common template for electronic archives, the archive compression storage module 50 performs the following steps: Step A01) extracting the value of each field of a preset number of electronic archives; Step A02) exhaustively enumerating the field combinations, counting the number of value types in the field combinations of the preset number of electronic archives, and calculating the total number of value types of the field combinations; Step A03) if the ratio of the number of value types to the total number of value types is lower than a preset threshold, the field combination is listed as an alternative field combination; Step A04) the field combination with the most fields included in the alternative field combination is the final common field combination. Step A05) stores the field composition of the final common field combination, and assigns a combination value number to each value of the field combination for a preset number of electronic files; Step A06) The final common field combination and the combination value number constitute a common template; Step A07) When a new electronic file of the same type is received, the closest combination value number is selected for the value of the common field combination, and the value that does not correspond to the selected combination value number is retained; Step A08) The retained values ​​of the common field combination and the field values ​​of the non-common field combination are used as unique content. Electronic files refer to data files that store data in pairs of fields and values, such as files in XML format. Files in electronic image format do not belong to the electronic files referred to in this embodiment. The fields of electronic files of the same type are the same, and the values ​​of the corresponding fields are different for different applicants. For a specific administrative service window, among the large number of electronic files received, the values ​​of several fields are the same. For example, the values ​​of province, city and ethnicity in the electronic archives received by a given window are basically the same. Using the combined value number Z1 to replace the values ​​of most of these three fields can greatly save storage space expenses. When encountering different value situations, the combined value number is not used, and the actual value can be stored completely. When restoring, if the combined value number Z1 is stored, the common field combination is filled in with the corresponding combined value. If the field value is stored, the stored file can be directly read.

[0020] When creating a common template for scanned documents, please refer to the attached Figure 3, the archive compression storage module 50 performs the following steps: Step B01) reads a preset number of scans to form a sample set; Step B02) counts the mean of each pixel of the sample set scans; Step B03) obtains a common pixel set, and the difference between the pixel value of the scans in the sample set and the pixel mean is lower than the preset threshold value on the pixels in the common pixel set; Step B04) creates a blank scan, sets the pixels recorded in the common pixel set to the pixel mean, and forms a common template; Step B05) divides the scan area into several rectangular areas, and numbers each rectangular area; Step B06) calculates the difference between the pixel values ​​of the same position of the scan and the common template in each rectangular area, and if there is a non-zero difference in the rectangular area, the difference is associated with the rectangular area number and stored; Step B07) The difference of all rectangular areas and the associated rectangular area number constitute unique content. Given a large number of paper application forms or qualification certification documents received by the window, the content has formatted terms, and only basic information needs to be filled in a small number of designated locations and signed. Therefore, most of the pixel values ​​in this type of scanned copy are the same, without considering the differences in scanning equipment and light. For example, various types of informed consent forms have the same recorded content and require the public to sign at the end. This type of informed consent form is an important document for determining the liability for subsequent disputes and needs to be stored for a preset period of time before it can be destroyed. In this embodiment, the informed consent form signed by the public is scanned, and the hash value is extracted after scanning, and the hash value is uploaded to the blockchain 60 for storage, and then the paper copy can be destroyed. The scanned copy stored in the blockchain 60 has legal effect, thereby reducing the number of files that need to be stored in paper form. However, when the number of such scanned copies is large, it takes up more storage space to store them in the file storage module 40. In this embodiment, by establishing a common template, only the signature area of ​​the informed consent form is stored separately as unique content, and the remaining part is stored as a common template. When reading, the separately stored signature area and the common template are spliced, and the hash value is extracted after splicing. The hash value extracted from the correctly spliced ​​file will be consistent with the hash value stored in the blockchain 60, proving the authenticity of the file, thereby saving a lot of storage space.

[0021] The archive scheduling module 30 records multiple types of archive reading requests with the same search field value within a short period of time, where the short period of time is a preset time length. If the number of times multiple types of archives are requested to be read within a short period of time exceeds a preset threshold, an archive association reading table is established to record the types of archives requested to be read within a short period of time. If an archive type in the archive association reading table is read, archives with the same search field value under other archive types in the archive association reading table are restored from the archive area to the storage area.

[0022] The beneficial technical effects of this embodiment are: the authenticity of the archives can be proved by the archive evidence module 20 with the help of the blockchain 60, and the authenticity of the archives can be verified between different departments, so as to provide real archive information for handling related matters and realize the trusted sharing of archives between departments; the archive scheduling module 30 establishes an archive index table, which can conveniently and quickly query the relevant archives of the masses and improve the efficiency of archive retrieval; the archive compression storage module 50 can compress the storage space occupied by electronic archives and scanned copies, saving storage space overhead. For infrequently used formatted archives that need to be stored for a long time, a large amount of storage space can be saved and financial expenses can be reduced.

[0023] Embodiment 2:

[0024] A blockchain-based archive storage system, based on the first embodiment, proposes a specific solution to the problem that when scanning a paper archive to obtain a scanned copy, the pixel values ​​of the same content area are not completely the same due to changes in the scanning equipment or light conditions. In this embodiment, when the archive receiving module 10 receives a new scan of the same type, it fine-tunes the pixel value of the scanned copy within a preset range so that the number of pixels that are the same as the common template is the largest. After confirmation by the scanner, the archive receiving module 10 receives the adjusted scanned copy. If the scanner does not confirm, the archive receiving module 10 receives the scanned copy before adjustment. Please refer to the attached Figure 4 , the method for fine-tuning the pixel value of the scanned copy within a preset range includes: step C01) calculating the difference between each pixel value of the scanned copy and the common template, if the absolute value of the difference is less than the preset threshold, then the corresponding pixel value is set to be the same as the common template; step C02) extracting the boundary of the scanned copy before adjustment, and the boundary of the scanned copy after adjustment, the boundary is a set of pixels whose pixel value and adjacent pixel value difference is greater than the preset threshold; step C03) if the boundary has not changed, then the adjustment is completed, if the boundary has changed, then the pixels near the changed boundary are restored to the pixel value before adjustment, and then the adjustment is completed. When the pixel adjustment value is not large, but the adjustment is clever, the boundary can still be formed, thereby forming an observable line or ink mark, which affects the authenticity of the document. Therefore, this embodiment limits the occurrence of boundaries exceeding the preset threshold during the adjustment process.

[0025] The above-described embodiment is only a preferred solution of the present invention and does not limit the present invention in any form. There are other variations and modifications without exceeding the technical solution described in the claims.

Claims

1. A blockchain-based archive storage system, characterized in that: The system comprises an archive receiving module, an archive notarization module, an archive scheduling module, an archive storage module and an archive compression storage module. The archive receiving module receives archives and archive descriptions. The archives are scanned copies of electronic archives or paper archives. The archive descriptions record archive types and search field values. The archive notarization module extracts the hash value of the archives and uploads it to the blockchain for storage. The archive scheduling module stores the archives in the archive storage module and establishes an archive index table. The archive index table records archive identifiers, hash values, archive types, search field values, archive storage time, archive descriptions and archive storage addresses. The archive compression module extracts the hash value of the archives and uploads it to the blockchain for storage. The storage module periodically checks the number of archives under each archive type. When the number of archives of the same type reaches a preset threshold, the percentage of duplicate content in the archive is determined. If the percentage of duplicate content exceeds the preset threshold, a common template is established to represent the archive as a superposition of the common template and the unique content. After associating the unique content of the archive with the common template identifier and the archive identifier, the archive is moved from the archive storage module to the archive compression storage module. When the archive scheduling module is requested to read the archive, the archive compression storage module reads the unique content and the common template, superimposes the unique content and the common template to restore the archive, verifies the hash value of the archive, and then submits it to the requester; When establishing a common template for scanned documents, the archive compression storage module performs the following steps: Read a preset number of scans to form a sample set; Calculate the mean value of each pixel in the statistical sample set scans; Obtaining a common pixel set, where the differences between the pixel values ​​of the scans in the sample set and the pixel mean are all lower than a preset threshold value at the pixels in the common pixel set; Create a blank scan, set the pixels recorded in the common pixel set as the pixel mean, and form a common template; Divide the scanned area into several rectangular areas and number each rectangular area; Calculate the difference between the pixel values ​​of the same position of the scanned image and the common template in each rectangular area. If there is a non-zero difference in the rectangular area, store the difference in association with the rectangular area number. The difference of all rectangular areas and the associated rectangular area numbers constitute unique content; When the file receiving module receives a new scan of the same type, it fine-tunes the pixel value of the scan within a preset range so that the number of pixels that are identical to the common template is maximized. After confirmation by the scanner, the file receiving module receives the adjusted scan. If the scanner does not confirm, the file receiving module receives the scan before adjustment. Methods for fine-tuning the pixel values ​​of scanned images within a preset range include: Calculate the difference between each pixel value of the scanned image and the common template. If the absolute value of the difference is less than a preset threshold, set the corresponding pixel value to be the same as the common template. Extracting the boundary of the scanned copy before adjustment and the boundary of the scanned copy after adjustment, wherein the boundary is a set of pixels whose difference between the pixel value and the adjacent pixel value is greater than a preset threshold; If the boundary has not changed, the adjustment is completed. If the boundary has changed, the adjustment is completed after the pixels near the changed boundary are restored to the pixel values ​​before the adjustment.

2. According to the blockchain-based archive storage system of claim 1, it is characterized in that: When establishing a common template for electronic archives, the archive compression storage module performs the following steps: Extract the value of each field of a preset number of electronic records; Exhaustively enumerate the field combinations, count the number of value types of a preset number of electronic archives in the field combinations, and calculate the total number of value types of the field combinations; If the ratio of the number of value types to the total number of value types is lower than a preset threshold, the field combination is listed as an alternative field combination; The field combination with the most fields included in the candidate field combination is the final common field combination; The field composition of the final common field combination is stored, and a combination value number is assigned to each value of the field combination of a preset number of electronic archives; The final common field combination and the combination value number constitute a common template; When receiving a new electronic file of the same type, the closest combination value number is selected for the value of the common field combination, and the value that does not correspond to the selected combination value number is retained; The values ​​of the common field combinations and the field values ​​of the non-common field combinations are retained as unique content.

3. A blockchain-based archive storage system according to claim 1 or 2, characterized in that: The archive scheduling module records multiple types of archive reading requests with the same search field value within a short period of time, where the short period of time is a preset time length. If the number of times multiple types of archives are requested to be read within a short period of time exceeds a preset threshold, an archive association reading table is established to record the types of archives requested to be read within a short period of time. If an archive type in the archive association reading table is read, archives with the same search field value under other archive types in the archive association reading table are restored from the archive area to the storage area.

Images