Log submitting and data updating method and device based on erasure codes and medium

By adopting the log submission and data update methods based on erasure code in distributed storage systems, incremental updates are solved, and the problem of write amplification and log replication efficiency are achieved, and efficient data updates and performance improvements are achieved.

CN119718766AActive Publication Date: 2025-03-28SOUTH CHINA AGRICULTURAL UNIVERSITY +1
7 Cites 0 Cited by

Patent Information

Application Number
CN202411740340.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-29
Publication Date
2025-03-28
Estimated Expiration
2044-11-29

AI Technical Summary

Technical Problem

The prior art is difficult to effectively solve the write amplification problem in distributed storage systems, resulting in a surge in the number of disk input or output operations, affecting system performance. In addition, the log replication method has the defect of complete replication, which affects the efficiency of data update.

Method used

The log submission and data update method based on erasure code is adopted. By receiving the data shard to be written, its log data is obtained, the node to which the target shard belongs, and incremental updates are performed. This method reduces the number of disk IO operations, reduces network traffic, and improves the efficiency of data update.

Benefits of technology

It effectively alleviates the problem of write amplification, improves the system's storage performance and response speed, reduces network load, and improves the efficiency of data updates.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention discloses a log submitting and data updating method and device based on erasure codes and a medium, the method can be applied to a leader node of a server cluster, a to-be-written data fragment is received firstly, then log data containing updating information of the data fragment is obtained, and the log submitting and data updating method based on the erasure codes is applied to the leader node of the server cluster. And then determining the node to which the target fragment corresponding to each data fragment belongs, and sending the log data to the corresponding node. After confirmation information which is from the node and is used for representing that the log data is correctly received is received, incremental updating can be carried out on the target fragment of the node according to the log data. According to the embodiment of the invention, the incremental updating strategy is adopted, the write amplification problem can be effectively relieved, and the data updating efficiency is improved.
Need to check novelty before this filing date? Find Prior Art