Data operation system and method based on data routing and sharding

Abstract

The invention relates to a data operation system and method based on data routing and sharding. The system comprises a top client layer, a middle DaaS layer, and a bottom database layer, wherein the client layer is used for providing operating data; the DaaS layer is used for analyzing SQL statements corresponding to the operating data to obtain sharding rules by means of data routing, positioning branch database corresponding to the operating data in the database layer according to the sharding rules, operating the operating data in the branch database through executing corresponding SQL statements, and returning operating results to the client layer; the database layer is used for providing memory space for operating data after operation in the DassS layer through providing multiple types of branch database. By means of the method and the system, the load of a single server is reduced, and the loss due to system crash is reduced to the least, and infinite horizontal extension of database is realized.

Description

technical field [0001] The invention relates to a data operating system and method, in particular to a data operating system and method based on data routing, sub-database and sub-table. Background technique [0002] In an application system, data reading, storage, updating, deletion, etc. are indispensable components. First, let’s understand from the following aspects: 1. With the widespread use of the Internet, the application system runs continuously, and the application Business data has also increased, and new requirements have been put forward for the storage and access of massive data; 2. When the application system ensures efficient response capabilities, operations such as querying, inserting, updating, and deleting data are very important; 3. Single The resources (CPU, disk, memory, network IO, number of transactions, number of connections) of a server are always limited, and eventually the amount of data that the database can carry and the data processing capacity...

AI Technical Summary

Problems solved by technology

Data operation is necessary for each business function, so the processing efficiency of business functions will be greatly affected by data operations. When high concurrency and the system are busy, data operations are the performance bottleneck of application system services, which restricts the throughput of business system processing. quantity

When the processing power of the database in a single server does not meet the requirements of the application system, the usual practice is to purchase a more powerful server with faster computing efficiency for replacement, but this cost is very high, and the original server will not be replaced. While utilizing support data manipulation

Images