6results about How to "Reduce write latency" patented technology

The application discloses a data management method and system suitable for IMR, wherein when a bottom track is updated, data of an effective top track is actively migrated to other free tracks; in the MFML data update strategy, a zigzag four-stage data management scheme is adopted, in the first stage, data of the bottom track is updated; in the second stage, the MFML strategy is adopted to update data of the bottom track; in the third stage and the fourth stage, data distribution and bottom track data update are continuously performed according to the mode of the second stage, and data management is realized. The application can make the MFML update strategy better play the performance in the four-stage data management scheme, and can also relieve the performance decline problem caused by the too high top track occupation amount of the multi-stage distribution scheme.

This application discloses a data processing method, apparatus, electronic device, and computer-readable medium, relating to the field of computer technology. A specific embodiment includes: obtaining a data stream and a cluster identifier based on a received data processing request; obtaining node data corresponding to the cluster identifier; generating a first hash value based on the node data; calculating a second hash value for each data item in the data stream; determining the target node corresponding to each data item in the data stream based on the first hash value, the second hash value, and a hash ring; determining the number of data items to be written for each target node; configuring an independent connection pool for each target node based on the number; and writing each data item to the corresponding target node based on the connection pool. This improves write performance and throughput when writing data to the cluster, avoids single-point overload, ensures uniform data distribution in the cluster, increases data write speed, and shortens data write latency.

The application discloses a data read-write processing method and an electronic device in a storage system, relates to the technical field of computer storage, and realizes the asynchronization and isolation of read-write operations by constructing a three-layer resource processing architecture, decoupling host read-write requests into independent controllable processing stages. The first resource focuses on recording metadata, the second resource serves as a temporary carrier for data transfer, and the third resource serves as a persistent cache management center. This architecture enables the write operation to return a response to the host as soon as the data reaches the second resource, greatly reducing the write delay; the read operation realizes non-blocking access through the concurrent control mechanism of the third resource. Overall, the response speed and throughput of the storage system are improved, and the performance bottleneck of mutual blocking of read and write due to competition for the same data resource in the related architecture is solved.

Embodiments of the present application provide a kind of storage, reading and archiving method, equipment, storage medium and program product of multiple copy data.In the embodiments of the present application, more than the number of storage nodes of copy is provided by fast fault-tolerant mechanism to store fault-tolerant, first write data in copy node, when the node of failure and within the fault-tolerant range, data is written to candidate node, it is beneficial to improve the success probability of multiple copy storage, without triggering the slow fault-tolerant mechanism of the above-mentioned trigger archiving data unit within the fault-tolerant range, reduce the probability of triggering the fault-tolerant mechanism, reduce the access impact to management node (such as MS), to improve the efficiency of data writing, reduce write delay.

The application discloses a kind of graph data heterogenous layered storage structure and method based on persistent memory, the application uses layered hash table heterogenous storage structure, stores the equivalent query data structure in topology data and index data in graph data, simultaneously using a layered storage B+Tree storage structure, stores the range query data structure in index data, solves the problem of query speed and limited memory space, simultaneously by converting the random write of persistent memory into sequential write, reduce write delay, by constructing the architecture of layered storage, reduce the write times of data structure in persistent memory, improve query efficiency.

The application discloses a kind of erasure code file processing method, device, equipment, medium and product, by real-time receiving the original data of user input;Using first proportion erasure code algorithm, the original data is handled, generates first erasure code file, and is stored to preset memory;Wherein, the first erasure code file includes several first data blocks and at least one first check block obtained by the original data division;According to second proportion erasure code algorithm, part of first data block and all first check block in N first erasure code file are read from the memory, at least one second check block is generated;The second check block and all first data blocks in the N first erasure code file are merged and stored to the memory as second erasure code file.Using the application, it can reduce data write delay, while avoiding the problem of flow amplification in data transfer process, effectively improve data storage efficiency.