Incremental File Anonymization Using Block-Level Bitmap Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current file anonymization methods are inefficient, leading to long processing times and reduced input/output efficiency during product development or testing, affecting the usability of sensitive information.
Innovation Solution
A file anonymization method and apparatus that performs anonymization processing on a storage device, allowing incremental anonymization of data blocks, combining online and offline methods to utilize previous anonymization results and maintain efficiency during development or testing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If complete anonymization processing is performed on all data blocks before file reading, then data privacy protection is ensured, but file reading time consumption increases and I/O efficiency decreases
Solution Approach 1:
The system performs preliminary anonymization processing on data blocks before they are needed for product development or testing. By pre-processing and storing anonymized data blocks, the system ensures privacy protection is established in advance, eliminating the need for time-consuming anonymization during file reading operations.
Solution Approach 2:
The file is divided into multiple data blocks, and the system tracks which blocks have been anonymized using a bitmap structure. This segmentation allows the system to selectively anonymize only the necessary blocks during file reading, rather than processing the entire file, thereby reducing time consumption while maintaining privacy protection.
2Reliability
If repeated anonymization processing is performed on files during product development or testing, then data privacy is maintained, but processing efficiency and I/O performance deteriorate
Solution Approach 1:
The system uses a bitmap to track the anonymization status of each data block and provides feedback during file reading operations. Based on this feedback, the system determines which blocks require anonymization and which are already processed, enabling repeated file access without redundant anonymization processing and maintaining both privacy and efficiency.
Solution Approach 2:
Instead of performing complete anonymization on all data blocks every time a file is accessed, the system performs partial anonymization only on the specific blocks that have not been processed yet. This partial action approach maintains data privacy where needed while significantly improving processing efficiency by avoiding unnecessary repeated processing.
3Reliability
If traditional anonymization methods are used, then data privacy protection is achieved, but time consumption increases and development or testing activities are delayed
Solution Approach 1:
The system performs anonymization processing in advance before product development or testing activities begin. By pre-processing files and storing the anonymized versions, the system eliminates the delay caused by waiting for anonymization to complete, allowing development or testing activities to start immediately while maintaining privacy protection.
Solution Approach 2:
The system enables continuous file access during product development or testing by maintaining anonymized copies that can be read without interruption. The useful action of anonymization is performed continuously in the background or in advance, ensuring that file access remains continuous and uninterrupted, thereby eliminating delays in development or testing activities.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
A file anonymization method and apparatus, and a storage medium are provided. The method is performed by a storage device. The method includes: receiving a file read command sent by a host, where the file read command is used to request a to-be-read file (S11); obtaining the to-be-read file in response to the file read command, where anonymization processing is completed on at least some data blocks in the to-be-read file (S12); performing anonymization processing on a data block on which anonymization processing is not performed in the to-be-read file (S13); and sending, to the host, the to-be-read file on which anonymization processing is completed (S14). In this method, incremental anonymization can be performed on the to-be-read file, so that a previous anonymization result can be fully used, and file anonymization efficiency can be improved.