Cloud Storage Erasure Coding for Dynamic Data Security Levels
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current cloud storage systems using Erasure Code (EC) for data protection face challenges in maintaining adequate security levels, particularly when user data is stored with a fixed security level N+M, which can lead to low security if more than M nodes fail, rendering user data unreadable.
Innovation Solution
A method and device that detect access counts of user data sets in a cloud storage resource pool, determine user data sets meeting specific access conditions, and re-encode them using an erasure coding algorithm with a higher security level (N+(M+i)) to enhance security by increasing the tolerance for abnormal nodes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If user data is stored with a fixed security level N+M, then storage efficiency is maintained, but data security deteriorates when more than M nodes fail
Solution Approach 1:
The patent applies dynamics by transforming the static fixed security level N+M into a dynamic adjustable security level. The system periodically detects access counts of user data sets and automatically adjusts the security level based on detected patterns, allowing the security parameter M to change from a fixed value to a dynamically adjustable value that adapts to actual data access patterns and security requirements
Solution Approach 2:
The patent implements parameter changes by modifying the security level parameters (specifically the security step M) based on access count detection results. When hot data is detected through access count analysis, the system increases the security level by adjusting parameter M upward, thereby changing the redundancy configuration from a fixed state to a variable state that responds to data importance and access patterns
2Reliability
If erasure coding is used for data protection, then data redundancy is achieved, but storage space consumption increases
Solution Approach 1:
The patent applies local quality by implementing differentiated security levels for different data sets based on their access patterns. Instead of uniformly applying high security (large M) to all data, the system identifies hot data through access count detection and applies enhanced security only to those specific data sets, while maintaining lower security levels for cold data, thereby optimizing the balance between data protection and storage space utilization
3Reliability
If security level is increased to protect against more node failures, then data readability is improved, but storage overhead increases
Solution Approach 1:
The patent implements partial action by applying enhanced security measures (increased redundancy) only to hot data sets that require higher protection, rather than excessively protecting all data uniformly. The system detects access patterns and selectively increases security level for identified hot data, avoiding unnecessary storage overhead for cold data that does not require the same level of protection
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
The embodiments of the present application provide a method and device for improving data storage security, related to the technical field of cloud storage. The method includes: detecting access counts of user data sets in a cloud storage resource pool, where the user data sets in the cloud storage resource pool are data obtained by encoding with an erasure coding algorithm of a first security level; determining a first user data set whose access count in the cloud storage resource pool meets a preset condition; obtaining a second security level according to attribute information of the cloud storage resource pool, wherein the attribute information includes the first security level and an increment for security step; and re-encoding the first user data set with an erasure coding algorithm of the second security level to obtain re-encoded first user data sets. Compared with the related data storage method, the embodiments of the present application improve the security of user data in the cloud storage resource pool.