Distributed system and incremental data updating method

Abstract

The present application proposes a distributed system and an incremental data updating method. The system comprises: a server, used for sending a data change notification to distributed clients; the distributed clients, used for receiving the data change notification from the server, sending a changed-data acquisition request to first middleware according to the data change notification, and receiving changed data returned by the first middleware; and the first middleware, used for receiving the changed-data acquisition request from the distributed clients, acquiring the changed data according to the changed-data acquisition request and returning the changed data to the distributed clients. The distributed system and the incremental data updating method provided by the embodiments of the present application reduce the access pressure on a database in the distributed system, reduce system resource consumption, and improve the incremental data updating speed of the distributed clients and the stability of the distributed system.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a distributed system and a data incremental update method. Background technique [0002] With the rapid development of the Internet, more and more users use the Internet, how to quickly respond to user requests has become one of the important means for various Internet companies to win users. For example, for a website containing a large amount of information, if the website responds to user requests too slowly, the number of users of the website will be lost over time. [0003] At present, the speed of response can be improved by caching, such as distributed caching. Since the cached data is stored in memory, and there is no need to interact with the database, such as a relational database, during the data access process, compared to querying from the database Generally speaking, fetching data directly from the cache is much faster. Usually, fetching data from the c...

AI Technical Summary

Problems solved by technology

[0005] 1. When the data is changed, it is fully refreshed, and the resource consumption is relatively large

For example, assuming that the total amount of data is 1000 records, only a few of them will be changed in one change. If all the data is loaded in full during the change process, the computing resources will be consumed.

[0006] 2. The changed data is often based on the data in the database, but in the read-write separation mode, if there is a delay between writing to the database and reading from the database, the application will not be able to read the latest written change information

[0007] 3. During the initialization process of the distributed cache data, the database access volume is large, the database access pressure is high, and the system is unstable

[0008] Therefore, the system update based on distributed cache is slow and unstable

Images