Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data fragment storage method, device and equipment

A technology of data storage and data sharding, applied in database distribution/replication, clustering/classification of other databases, retrieval of other databases, etc., can solve problems such as unbalanced data storage, reduce storage and reduce unbalanced data storage Effect

Pending Publication Date: 2021-10-29
深圳市汉云科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the embodiment of the present application provides a data slice storage method, device and equipment, to solve the problem of unbalanced data storage in the prior art when data storage is carried out by means of Hash slices

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data fragment storage method, device and equipment
  • Data fragment storage method, device and equipment
  • Data fragment storage method, device and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In the following description, specific details such as specific system structures and techniques are proposed for explanation, such as specific details, such as specific system structures, and techniques. However, it will be apparent to those skilled in the art that the present application can also be implemented in other embodiments without these specific details. In other cases, a detailed description of well known systems, devices, circuits, and methods is omitted to prevent unnecessary details to prevent the presentation.

[0039] In order to illustrate the technical solution described herein, the following will be described below.

[0040] Current data fragment storage methods typically include a HASH fragmentation, random fragmentation and full copy of the slice. in:

[0041] In the HASH fragmentation, by calculating the HASH value of the predetermined field in the data to be stored, the corresponding node is mapped according to the HASH value. If there is a total of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the field of data storage, and provides a data fragment storage method, device and equipment. The method comprises the following steps: determining a data category in to-be-stored data, wherein the data category comprises a first category and a second category; when the to-be-stored data corresponds to a first category, calculating a Hash value corresponding to the to-be-stored data, determining a storage node corresponding to the to-be-stored data according to the Hash value, and performing data storage according to the storage node; and when the to-be-stored data corresponds to a second category, determining a storage node corresponding to the to-be-stored data according to the amount of data stored by the node, and performing data storage according to the determined storage node. Therefore, the problem of unbalanced data storage caused by centralized distribution of the data of the second category can be reduced, and the probability of storage and query efficiency bottleneck caused by unbalanced data storage is reduced.

Description

Technical field [0001] This application belongs to the field of data storage, and more particularly to data fragment storage methods, devices, and devices. Background technique [0002] In a distributed database, common data fragmentation mainly includes Hash fractional, random fragmentation and full copy of the slice. Among them, the HASH fragmentation mode is mapped to the corresponding node based on the HASH value by calculating the HASH value of the field. For example, there are 10 nodes in the cluster, by calculating the HASH value corresponding to the field, ensuring that the same field is stored in the same node. When some hierarchical or association is performed, there is no need to restructuring the data reorganization, greatly enhance the grading statistics or Associated performance. [0003] However, in some application scenarios, the 20% "unrecognized card" can only be stored in one node when there is 20 nodes to store the passenger data, and 20% of the "unrecognized ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/901G06F16/906G06K9/32G06F16/27
CPCG06F16/9014G06F16/906G06F16/27
Inventor 熊志强
Owner 深圳市汉云科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com