Data processing method and device, computer equipment and storage medium

A data processing and proxy layer technology, applied in the computer field, can solve problems such as increasing the pressure on the main database and affecting the effect of reading and writing separation

Pending Publication Date: 2022-04-12
BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The above method directly connects strongly consistent read and write requests to the main library, which will increase the pressure on the main library and affect the effect of read and write separation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, computer equipment and storage medium
  • Data processing method and device, computer equipment and storage medium
  • Data processing method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, but not all of them. Based on the embodiments in the present application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present application.

[0046] figure 1 It is an application environment diagram of a data processing method in an embodiment. refer to figure 1 , the data processing method is applied to the database reading and writing system. The database reading and writing system includes an agent layer 110 , a master library 120 and a slave library 130 . The agent la...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data processing method and device, computer equipment and a storage medium. The method comprises the following steps: receiving a read request, wherein the read request carries a session identifier; acquiring a primary library synchronization log site corresponding to the session identifier; receiving a slave library synchronization log site reported by the slave library; when the synchronization log site of the master library is larger than or equal to the synchronization log site of the slave library, a read request is sent to the master library, and when the synchronization log site of the master library is smaller than the synchronization log site of the slave library, the read request is sent to the slave library. A master library synchronization log site of each session is stored in an agent layer, the offset of a request in a change log in a master library, namely a synchronization log site, and a synchronization log site reported by a slave library are determined according to a session identifier in a read request, and whether the current synchronization log site of the slave library exceeds the synchronization log site of the master library is judged; if yes, the data are read through the slave library, otherwise, the data are read through the master library, and the reading pressure of the master library is reduced.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to a data processing method, device, computer equipment and storage medium. Background technique [0002] In the read expansion scenario, industry databases generally adopt a read-write separation architecture. That is, the write request is sent to the master library through the proxy layer, and the read request is sent to the slave library. Since there is a certain synchronization delay between the master and the slave, the read-write consistency of business access cannot be guaranteed, only the final consistency can be guaranteed. In order to solve the above problems, the business is split, and the read and write requests required by strong consistency are directly connected to the main library, and the part of final consistency can be separated from reading and writing. The above method directly connects strongly consistent read and write requests to the main li...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27
CPCG06F16/27
Inventor 王天宇
Owner BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products