A distributed data processing method and device

Abstract

The invention discloses a distributed data processing method and device, and relates to the technical field of computers. A specific embodiment of the method comprises the steps of obtaining a computing service, wherein the computing service comprises an SQL command; obtaining address information of the SQLite Node; selecting an SQLite Node corresponding to the address information from a list of adatabase cluster as an execution machine; and executing the SQL command in the execution machine. According to the embodiment, the technical problem that SQL grammar is not supported is solved, complex computing services can be better supported, and therefore the beneficial effects that the development period is shortened, and the cost is reduced are achieved. Meanwhile, the read-write performance is high, the concurrency is high, horizontal expansion is supported, and the method is more suitable for the field of real-time computing; as a lightweight distributed architecture, the SQLite database cluster avoids the problems of very high cost, high maintenance manpower and material resources, high learning cost and the like.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a distributed data processing method and device. Background technique [0002] Nowadays, information technology has become an indispensable basic service facility in various fields. As the carrier of server-side data, database is the core part of various information systems for data management and analysis. Traditional relational databases focus on data persistence, consistency, and data security. The non-relational database has high read and write performance, supports horizontal expansion, can temporarily store and calculate real-time data, and can well support high real-time business scenarios. [0003] In the process of realizing the present invention, the inventors found that there are at least the following problems in the non-relational databases and relational databases in the prior art: [0004] 1. The calculation model of the existing non-relational database...

AI Technical Summary

Problems solved by technology

[0004] 1. The calculation model of the existing non-relational database is relatively simple and does not support SQL syntax. When the data model is complex and changes frequently, it is necessary to implement a lot of existing calculation logic of SQL through code, which leads to long development cycle and high cost

[0005] 2. For data with short timeliness, frequent writes, and large elastic changes in data volume, traditional relational databases have limited write performance, concurrency performance, and horizontal expansion capabilities, and cannot be applied; while large-scale distributed relational databases are expensive to use , high manpower and material resources for maintenance, and high learning costs

Images