Techniques for performing data reconciliation in distributed data store systems

Abstract

In one embodiment, a data reconciliation engine works with data store nodes included in a distributed data store system to ensure consistency between the data store nodes. In operation, the data reconciliation receives a different data snapshot from each of the data store nodes. In response, the data reconciliation engine generates one or more recommendations designed to resolve inconsistencies between the data snapshots. The data reconciliation engine then transmits each recommendation to a different data store node. Because the data reconciliation engine performs many of the resource-intensive operations included in the data reconciliation process, the resources of the data store nodes may focus primarily on processing client requests instead of performing data reconciliation operations.Consequently, unlike conventional data store node based reconciliation applications, the data reconciliation engine may process large volumes of data without unacceptably increasing the time requiredfor the distributed data store system to respond to client requests.

Description

[0001] Related Application Cross Reference [0002] This application claims the benefit of US Patent Application Serial No. 14 / 987,649, filed January 4, 2016, which is hereby incorporated by reference. technical field [0003] Embodiments of the present invention relate generally to computer science and, more particularly, to techniques for performing data coordination in distributed data storage systems. Background technique [0004] Many distributed data storage systems store clients' data in clusters of nodes located in multiple geographic regions. Nodes within a cluster are typically interconnected computers or virtual machines, where each computer manages storage and provides services through a client-server architecture. Typically, in a client-server architecture, a client requests a service, and in response, a server provides the service. More specifically, when a client submits a read or write request to the distributed data storage system, the nodes included in t...

AI Technical Summary

Problems solved by technology

Node resources consumed by the data reconciliation process are not available to process client requests

Therefore, as the amount of data increases, the performance of the distributed storage system can degrade significantly, and the time required for the distributed data storage system to respond to client requests can increase to an unacceptable level

Images