Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method, device and system, equipment and medium

A data processing system and data processing technology, applied in the database field, can solve the problems affecting data processing efficiency, large disk read and write volume, low expansion flexibility, etc., to improve scalability, storage node convenience, and flexible storage engine replacement. Effect

Pending Publication Date: 2021-06-11
BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the above-mentioned multi-replica set or fragmented cluster architecture, data synchronization between nodes is required, and the amount of disk read and write is large, which affects data processing efficiency, and the calculation and storage are on the same node, and the expansion flexibility is low.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, device and system, equipment and medium
  • Data processing method, device and system, equipment and medium
  • Data processing method, device and system, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In order to more clearly understand the above objects, features and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0025] In the following description, many specific details are set forth in order to fully understand the present disclosure, but the present disclosure can also be implemented in other ways than described here; obviously, the embodiments in the description are only some of the embodiments of the present disclosure, and Not all examples.

[0026] In the prior art, the database can adopt a high-availability architecture of a multi-node replica set, which is a cluster constructed by a primary node and multiple secondary nodes. When the primary node fails, the secondary node can be upgraded to the primary node , to ensure high availa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention relates to a data processing method, device and system, equipment and a medium, and relates to the field of cloud computing. The data processing system comprises a computing node cluster and a storage engine, the computing node cluster is in communication connection with the storage engine, the computing node cluster comprises at least two computing nodes, the storage engine comprises a storage node cluster, and the computing nodes are used for: receiving a data processing request, sending the data processing request to a storage engine, receiving an initial data processing result returned by the storage engine, and calculating the initial data processing result to obtain a target data processing result. By the adoption of the technical scheme, due to the fact that all the computing nodes share one storage engine, data synchronization between the computing nodes and separation of the computing nodes and the storage nodes are not needed, and the expandability of the cluster is improved; and the data processing process of the computing node and the storage engine is separated, so that the data processing efficiency is improved, and the read-write amount of a disk is reduced.

Description

technical field [0001] The present disclosure relates to the technical field of databases, and in particular to a data processing method, device, system, equipment and medium. Background technique [0002] In order to prevent data loss, multiple replica sets of master-slave architecture can be used in the database to provide redundant backup of data and services, and more data can be stored in the form of fragmented clusters. [0003] However, in the above-mentioned multi-replica set or fragmented cluster architecture, data synchronization between nodes is required, and the amount of disk read and write is large, which affects the data processing efficiency, and the calculation and storage are on the same node, and the expansion flexibility is low. Contents of the invention [0004] In order to solve the above technical problems or at least partly solve the above technical problems, the present disclosure provides a data processing method, device, system, equipment and med...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/14G06F16/27
CPCG06F11/1464G06F16/27
Inventor 宫伯钊李晓静
Owner BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More