User-defined data fragmentation method, device and equipment based on distributed database

A data sharding and database technology, applied in the database field, can solve the problems of inability to meet the requirements of data sharding with special rules and low efficiency of sharding processing, so as to achieve whether the data is updated clearly and orderly, prevent data sharding from confusion, The effect of improving efficiency

Pending Publication Date: 2020-03-27
湖南亚信安慧科技有限公司
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Therefore, the technical problem to be solved by the present invention is to overcome the low efficiency of sharding processing in the prior art and the inability to meet the needs of data sharding with special rules, thereby providing a self-defined data sharding method based on a distributed database, Devices and equipment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • User-defined data fragmentation method, device and equipment based on distributed database
  • User-defined data fragmentation method, device and equipment based on distributed database
  • User-defined data fragmentation method, device and equipment based on distributed database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] Data fragmentation is one of the characteristics of distributed databases. In a distributed database, each local database is obtained from a certain logical fragmentation of the global database, that is, the global database is divided into small data fragments according to a certain logic. In order to operate separately, data sharding is achieved through basic operations of algebra. For the data objects in the database, the user is the subject of the data object viewing operation, but for different users, their viewing rights to the data are not the same, for example, the data of the entire company is stored in a table, but a certain type The data can only be viewed by a certain department as the subject of the operation. In this case, the data needs to be fragmented. This embodiment provides a method for customizing data fragmentation based on a distributed database, such as figure 1 shown, including the following steps:

[0032] S110: Obtain at least one column of d...

Embodiment 2

[0061] This embodiment provides a self-defined data fragmentation device based on a distributed database, such as image 3 shown, including:

[0062] The obtaining module 210 is configured to obtain at least one column of data to be fragmented in the list to be processed; for a specific implementation, refer to S110 in Embodiment 1, which will not be repeated here.

[0063] The first determination module 220 is configured to determine the sharding rule; see S120 in Embodiment 1 for the specific implementation manner, which will not be repeated here.

[0064] The configuration module 230 is configured to configure the fragmentation function according to the fragmentation rule; see S130 in Embodiment 1 for the specific implementation manner, which will not be repeated here.

[0065] The first storage module 240 is configured to store the corresponding relationship between the slice function and the list to be processed in a system table; see S140 in Embodiment 1 for a specific ...

Embodiment 3

[0081] The embodiment of the present application also provides a self-defined data fragmentation device based on a distributed database, such as Figure 5 As shown, a processor 510 and a memory 520, wherein the processor 510 and the memory 520 may be connected through a bus or in other ways.

[0082] The processor 510 may be a central processing unit (Central Processing Unit, CPU). The processor 510 may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application-specific integrated circuits (Application Specific Integrated Circuit, ASIC), field-programmable gate array (Field-Programmable Gate Array, FPGA) or Other chips such as programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or combinations of the above-mentioned types of chips.

[0083] The memory 520, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs, non-transit...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a self-defined data fragmentation method, device and equipment based on a distributed database. The method comprises the following steps: obtaining at least one column of to-be-fragmented data in a to-be-processed list; determining a fragmentation rule; configuring a fragmentation function according to the fragmentation rule; storing the corresponding relationship between the fragmentation function and the to-be-processed list into a system table; determining a row data node for storing the to-be-fragmented data according to the system table and the to-be-fragmented data; and storing the row data of the to-be-fragmented data into the corresponding data node. According to the method, the fragmentation processing efficiency is improved, the applicability of the fragmentation algorithm is improved, and the fragmentation requirements with special rules are met.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a distributed database-based self-defined data fragmentation method, device and equipment. Background technique [0002] Fragmentation refers to the practice of dividing rows or columns in a table into multiple different tables. One aspect of database sharding can help facilitate horizontal scaling, also known as scaling out. Horizontal scaling is adding more machines to an existing stack to spread the load, allowing more traffic and faster processing; on the other hand, it can speed up query response time. [0003] In related technologies, there are two methods of sharding algorithms for databases: first, data is sharded through configuration files; second, data is sharded through built-in sharding algorithms such as hashing, polling, and modulo. In the case of a large number of tables in the system, the efficiency of sharding through configuration files is extremely low and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/22G06F16/23G06F16/2458
CPCG06F16/27G06F16/2282G06F16/23G06F16/2471
Inventor 姜明俊
Owner 湖南亚信安慧科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap