Unlock instant, AI-driven research and patent intelligence for your innovation.

Data fragmentation method, device, electronic equipment and storage medium

A data sharding and data technology, applied in the computer field, can solve problems such as poor versatility and low development efficiency, and achieve the effect of improving efficiency and improving versatility

Active Publication Date: 2020-02-14
BEIJING SANKUAI ONLINE TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] It can be seen that the data fragmentation method in the prior art has at least the defects of poor versatility and low development efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data fragmentation method, device, electronic equipment and storage medium
  • Data fragmentation method, device, electronic equipment and storage medium
  • Data fragmentation method, device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] A data sharding method in an embodiment of the present disclosure, such as figure 1 As shown, the method includes: Step 110 to Step 130.

[0024] Step 110, intercepting data operations in preset database operations through aspect-oriented programming technology.

[0025] Aspect Oriented Programming (AOP, Aspect-Oriented Programming), the main purpose of realization is to extract aspects in the business processing process, which is facing a certain step or stage in the processing process, so as to obtain the The isolation effect of low coupling between. In specific implementation, the isolation effect can be achieved by using a dynamic proxy class (Proxy) to intercept the behavior of an object and add the functions we need. The data sharding methods disclosed in the embodiments of the present disclosure are combined into data service-based applications in the prior art in the form of middleware or other forms. The application architecture of the data fragmentation met...

Embodiment 2

[0063] A data fragmentation device disclosed in this embodiment, such as image 3 As shown, the device includes:

[0064] A data operation interception module 310, configured to intercept data operations in preset database operations through aspect-oriented programming techniques;

[0065] A data operation mapping module 320, configured to map the intercepted data operation to a preset data processing module;

[0066] The data processing execution module 330 is configured to determine a target data source according to a data processing policy matched with the data processing module, and perform a data operation corresponding to the intercepted data operation on the target data source, wherein the The data processing strategy is obtained by the data service from the configuration module in advance for local caching.

[0067] In some embodiments of the present disclosure, the data operation interception module 310 is further configured to: obtain the entry point of a predefine...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data fragmentation method, which belongs to the technical field of computers, and is used for solving the problem of poor universality of data fragmentation in the prior art.The data fragmentation method disclosed by the embodiment of the invention comprises the following steps of intercepting a data operation in a preset database operation for a section programming technology; mapping the intercepted data operation to a preset data processing module; determining a target data source according to a data processing strategy matched with the data processing module, conducting the data operation corresponding to the intercepted data operation on the target data source, and obtaining the data processing strategy by a data service from a configuration module in advanceand conducts local caching. According to the data fragmentation method disclosed by the embodiment of the invention, the data fragmentation method is enhanced between the application layer and the bottom layer data sub-library or the data table based on the section-oriented technology, and the data fragmentation strategy is imported through the configuration module, so that the universality of the data fragmentation method is improved.

Description

technical field [0001] The present disclosure relates to the field of computer technology, in particular to a data fragmentation method, device, electronic equipment and storage medium. Background technique [0002] Large-scale Internet applications have the characteristics of massive data, large traffic, and high concurrency. The typical "one master and multiple slaves" database architecture cannot meet the rapid development of business. An effective solution is to split the database horizontally and establish a "multi-master and multi-slave" database architecture, that is, data sharding. In the process of establishing a "multi-master and multi-slave" database architecture, data fragmentation is a necessary process. Data fragmentation processing involves a large number of data tables and massive data. In the existing technology, the conventional data sharding scheme is: implement online double-writing for multiple slave data servers and master servers within a period of t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/21
Inventor 陈乐乐邵晓明宋彬刘军周艺伟
Owner BEIJING SANKUAI ONLINE TECH CO LTD