Data processing method, data processing device, data processing equipment and computer-readable storage medium

A data processing and computer program technology, applied in the field of information processing, can solve problems such as uneven data storage

Active Publication Date: 2018-07-31
PING AN TECH (SHENZHEN) CO LTD
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The hash value after hashing of each piece of data has the characteristics of random distribution in the consistent hash ring, that is to say, the distribution of the hash value after data hash on the consistent hash ring may appear sparse and dense , so that if you look for storage nodes in a clockwise direction to store data, it will easily lead to uneven data storage; in addition, when the number of storage n

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, data processing device, data processing equipment and computer-readable storage medium
  • Data processing method, data processing device, data processing equipment and computer-readable storage medium
  • Data processing method, data processing device, data processing equipment and computer-readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0032] It should be understood that when used in this specification and the appended claims, the terms "comprising" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude one or Presence or addition of multiple other features, integers, steps, operations, elements, components and / or collections thereof.

[0033] It should also be understood that the term "and / or" use...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method, a data processing device, data processing equipment and a computer-readable storage medium. The method includes: calculating the number of needed datatables, which are used for saving received customer label data, according to the amount of the customer label data, and creating the corresponding number of data tables; constructing a consistency hash ring, and uniformly mapping the data tables to the consistency hash ring; acquiring primary-key fields of all the the customer label data; utilizing a consistency hash algorithm to carry out hash processing on the primary-key fields to obtain hash values corresponding to the customer label data, wherein one hash value is equal to one space value on the consistency hash ring; determining a data table, which is used for storing corresponding customer label data, according to the hash values; and saving the customer label data in the data table. According to the method, the large amount of customer label data can be uniformly stored into all the data tables through a manner of hash table-dividing.

Description

technical field [0001] The present invention relates to the technical field of information processing, in particular to a data processing method, device, equipment and computer-readable storage medium. Background technique [0002] Projects often encounter situations where a large amount of data (ranging from hundreds of millions to billions) needs to be written into the database. The general method is to write stored procedures. [0003] At present, there is a method of storing large amounts of data in batches. The storage nodes are mapped to the consistent hash ring through the consistent hash algorithm, and the storage nodes are searched clockwise on the consistent hash ring according to the hash value of each piece of data. The data storage node finally writes the data to the corresponding storage node. [0004] The hash value after hashing of each piece of data has the characteristics of random distribution in the consistent hash ring, that is to say, the distribution ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/2255
Inventor 邢方山
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap