Strip-End File Encoding for Incomplete Stripe Redundancy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing file processing methods in cloud computing suffer from low generation efficiency and large space occupancy due to the use of zero padding and redundant encoding for incomplete strips, leading to inefficient storage and resource utilization.
Innovation Solution
A method that determines a redundant storage policy based on the occupancy of additional data within a strip, employing copy or erasure code encoding strategies to generate restoration records, thereby optimizing storage efficiency and reducing space occupancy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If zero padding is used to fill incomplete strips, then complete strips are formed for encoding, but storage space occupancy increases and generation efficiency decreases
Solution Approach 1:
The patent segments the strip into two parts: a first part containing the actual additional data, and a second part containing the restoration record. This segmentation allows the restoration record to be generated only for the actual data portion rather than padding the entire strip, thereby improving generation efficiency while maintaining data security through proper segmentation and encoding of the actual data portion.
2Reliability
If zero padding is used to fill incomplete strips, then complete strips are formed for encoding, but storage space occupancy increases
Solution Approach 1:
The patent extracts only the necessary portion of data (the first part containing actual additional data) for generating the restoration record, rather than processing the entire padded strip. This extraction principle reduces the amount of data that needs to be encoded and stored, thereby reducing space occupancy while maintaining data security through proper encoding of the extracted data portion.
3Reliability
If redundant encoding is applied to padded strips, then data restoration capability is ensured, but resource utilization decreases
Solution Approach 1:
The patent applies partial action by generating restoration records only for the necessary data portion (first part with actual additional data) rather than performing redundant encoding on the entire padded strip. This partial encoding approach maintains data restoration capability for the actual data while reducing the computational resources and energy required for encoding operations.
Data Source
AI summary
Embodiments of the present disclosure provide a file processing method and apparatus, and an electronic device. The method includes: acquiring additional data written to a file end of a target file, where data in the target file is stored based on a strip, and a data end of the additional data is located in a middle of a target strip; obtaining a corresponding redundant storage policy according to an occupancy of the additional data in the target strip, and generating a restoration record of the additional data based on the redundant storage policy; and writing the restoration record into a disk.


