Incremental File Anonymization for Faster Storage I/O
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current file anonymization processes are inefficient, leading to long time consumption and reduced input/output efficiency during product development or testing, as they often require repetitive anonymization and affect I/O efficiency.
Innovation Solution
A method and apparatus for file anonymization in storage devices that perform incremental anonymization on data blocks, combining online and offline anonymization to utilize previous anonymization results, and manage anonymization status through bitmaps and marks, allowing continuous development or testing without unnecessary reprocessing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If complete anonymization processing is performed on all data blocks every time, then data privacy protection is ensured, but processing time increases and I/O efficiency decreases
Solution Approach 1:
The system performs preliminary anonymization processing on data blocks and stores the results. When data is accessed again, the previously anonymized data is reused without reprocessing, thereby reducing processing time while maintaining privacy protection
Solution Approach 2:
The system uses feedback mechanisms (such as bitmaps or marks) to track which data blocks have been anonymized. This feedback information is used to determine whether re-anonymization is necessary, optimizing the balance between privacy protection and processing efficiency
2Reliability
If anonymization processing is performed on all data blocks, then privacy protection is maintained, but input/output efficiency during development or testing is reduced
Solution Approach 1:
The system segments data into data blocks and tracks anonymization status at the block level. This allows selective processing where only unanonymized blocks are processed, while already anonymized blocks are served directly, maintaining privacy where needed and improving I/O efficiency where not required
Solution Approach 2:
Anonymization processing is performed in advance on data blocks before they are needed for development or testing. The results are stored and reused, allowing continuous development activities without repeated anonymization processing that would reduce I/O efficiency
Data Source
AI summary
The present disclosure provides a method, an apparatus, and a storage medium for file anonymization. The method is performed by a storage device. The method includes: receiving a file read command sent by a host, where the file read command is used to request a to-be-read file, the to-be-read file comprises a plurality of data blocks; obtaining the to-be-read file in response to the file read command, where the plurality of data blocks in the to-be-read file comprises one or more first data blocks that do not have anonymization processing performed thereon and one or more second data blocks that have anonymization processing completed thereon; performing anonymization processing on a first data block in the to-be-read file; and sending, to the host, the to-be-read file on which anonymization processing is completed.