Data updating method, and data query method and apparatus

Abstract

Embodiments of the invention disclose a data updating method, and a data query method and apparatus. The data updating method comprises the steps of storing to-be-updated data corresponding to a received data updating request in a preset number of data fragmentation queues based on a preset fragmentation rule; traversing each data fragmentation queue in response to a preset fragmented data summarization triggering instruction, and updating fragment summarization data in a fragment summarization data cache corresponding to the data fragmentation queue based on the to-be-updated data in the data fragmentation queue when each data fragmentation queue is traversed; and obtaining the fragment summarization data from the fragment summarization data cache in response to a preset data summarization triggering instruction, and updating the summarization data in the summarization data cache based on the fragment summarization data. By utilizing the data updating method, the system performance can be improved on the basis of ensuring data consistency, and the system availability in a high-concurrency scene is greatly improved.

Description

technical field [0001] The present application relates to the field of Internet communication technologies, and in particular, to a data update method, data query method and device. Background technique [0002] With the rapid development of Internet communication technology, some large-scale Internet systems will have a large number of distributed scenarios due to complex business and other reasons. A large number of high concurrency scenarios often appear in distributed transaction scenarios. In high concurrency scenarios, the summary data needs to be updated in time to ensure data consistency when subsequent queries read the data. [0003] In the prior art, there are mainly the following two schemes for updating and reading summary data in high concurrency scenarios: the first is a pure database scheme, in which the summary data is directly stored in the database, and the summary data is directly updated and read in the database. data. The second is the data sharding s...

AI Technical Summary

Problems solved by technology

[0005] In the existing pure database solution, the summary data is directly updated and read in the database. Although the high consistency of data can be guaranteed, the performance in high concurrency scenarios is poor, and there will be database failures and the need for data storage update operations in the database. Locking data objects leads to problems such as data hotspots and insufficient system availability

The data sharding scheme can optimize the hotspot issues of update requests through shard updates, but the update and query data still directly operate the database, and there are time-consuming extensions for update requests, summary timeout of shard data, and initialization for projects that have already been launched. There are problems such as difficulty in summarizing data in fragments, and the performance in high-concurrency scenarios has not been improved.

Images