Data storage method and device

A data storage and data tuple technology, applied in the computer field, can solve problems such as ineffective data migration and high data storage costs

Active Publication Date: 2016-04-20
CHINA CONSTRUCTION BANK
View PDF2 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the database layer still relies on a single centralized database, especially today with the rapid development of the credit card business and the record data of the transaction database has reached the level of 10 billion. The bottleneck phenomenon of storing data in the database layer is becoming more and more serious, which can only be supported by expansion. The growth of business volume, however, the way of supporting the growth of business volume through capacity expansion often leads to the increase of data storage cost and the problem that data migration cannot be effectively realized

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device
  • Data storage method and device
  • Data storage method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] figure 1 It is a flow chart of a data storage method provided in Embodiment 1 of this application.

[0057] Embodiment 1 of this application provides such as figure 1 One data storage method is shown applied to physical nodes.

[0058] In the embodiment of the present application, preferably, the physical node is a data storage unit, such as a hard disk.

[0059] Specifically, the inventor can arbitrarily set the number of physical nodes according to his own needs, which is not limited here.

[0060] Such as figure 1 As shown, the method includes:

[0061] S101. Divide the data to be stored into multiple data tuples, the data tuples include the information to be stored associated with the customer indicated by the unique customer information in the data to be stored;

[0062] In the embodiment of the present application, preferably, when there is data that needs to be stored in a physical node, that is, when there is data to be stored, it is first necessary to divi...

Embodiment 2

[0108] Figure 6 It is a schematic structural diagram of a data storage device provided in Embodiment 2 of the present application.

[0109] Such as Figure 6 As shown, the device includes:

[0110] A dividing unit 61, configured to divide the data to be stored into a plurality of data tuples, the data tuples include the information to be stored associated with the customer indicated by the unique customer information in the data to be stored;

[0111] The first mapping unit 62 is configured to use a preset consistent hash algorithm to map each data tuple into a virtual ring organized by a hash value space;

[0112] The determination unit 63 is used to determine the positions corresponding to each physical node in the virtual circle according to the position of the data tuple in the virtual circle and the position of the predefined virtual node corresponding to the physical node in the virtual circle through the consistent hash algorithm. The data tuple corresponding to the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data storage method and device. The data storage method comprises the steps of partitioning data to be stored into multiple data tuples, utilizing the Consistent Hash algorithm for mapping all the data tuples into a virtual circular ring formed through spatial organization of Hash values, and then utilizing the data tuples and the positions, in the virtual circular ring, of predefined virtual nodes corresponding to physical nodes for determining the data tuples which correspond to all the physical nodes respectively, so that data storage is achieved in a mode that information to be stored in the data tuples is stored into the physical nodes corresponding to the data tuples. By means of the data storage method, data migration can be effectively achieved by moving the virtual nodes on the basis of data storage, and the problem that data storage cost is increased when data storage is achieved through capacity expansion is avoided.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a data storage method and device. Background technique [0002] With the rapid development of credit card business, the open platform back-end service system that provides transaction services is becoming more and more important. The traditional open platform back-end service system basically adopts a two-tier architecture consisting of an application layer and a database layer. [0003] In recent years, although the application layer has realized distribution and horizontal expansion through service-oriented and stateless processing. However, the database layer still relies on a single centralized database, especially today with the rapid development of the credit card business and the record data of the transaction database has reached the level of 10 billion. The bottleneck phenomenon of storing data in the database layer is becoming more and more serious, which c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0667G06F3/067
Inventor 邢磊舒展贾国琛聂砂黎育龙杨宇鹏
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products