A method and system for fragmenting and storing data

A technology for storing data and memory, which is applied in the field of fragmented data storage, can solve problems affecting performance, complex costs, and large engineering workload, and achieve the effect of solving unbalanced distribution, data migration and cutover

Inactive Publication Date: 2019-07-16
CHINA TELECOM CLOUD TECH CO LTD
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, based on distributed databases, business data is mostly hashed and fragmented according to the data primary key identifier. When the business object data association level is relatively flat, the data storage distribution is relatively uniform; and a certain part of the business object data association level is deep. , When the structure is large and complex, and the access is relatively frequent, this part of the data storage will be concentrated in one or several shards according to the existing sharding method, which will lead to unbalanced load and affect performance
When a database is fully loaded, the expansion of the database requires data migration and cutover, which is a large, complex and costly project

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for fragmenting and storing data
  • A method and system for fragmenting and storing data
  • A method and system for fragmenting and storing data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that relative arrangements of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0033] At the same time, it should be understood that, for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0034] The following description of at least one exemplary embodiment is merely illustrative in nature and in no way intended as any limitation of the disclosure, its application or uses.

[0035] Techniques, methods and devices known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, such techniques, methods and devices should be considered part of t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and system for fragmenting and storing data, and relates to the technical field of data storage. The method comprises the following steps of fragmenting the basic dataof a business object, and mapping each group of fragmented basic data to one or more volume identifiers; mapping each sub-volume identifier to one physical node so as to store each group of basic dataon the corresponding physical node; and when the associated data of the business object is stored, searching a volume division identifier of the basic data corresponding to the associated data, and storing the associated data on a physical node to which the volume division identifier is mapped. According to the method and the system, the distributed data storage based on dynamic volume division is realized, and the problem of unbalanced distribution of some larger business object data in the prior art is solved.

Description

technical field [0001] The present disclosure relates to the technical field of data storage, and in particular to a method and system for storing data in slices. Background technique [0002] At present, with the increase in the number of users in the industry, the increasingly complex business, and the increasing amount of data, the data storage method has shifted from traditional centralized databases to distributed database fragmented storage. The fragmentation and distribution of distributed database data has a great impact on the availability, reliability and efficiency of the entire system. There are three basic approaches to data sharding in distributed databases. They are implemented through basic operations of relational algebra, including horizontal sharding, vertical sharding, and hybrid sharding. That is, the data is distributed to different nodes for storage according to certain segmentation rules, and the data is searched and accessed through the established...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/27G06F3/06
CPCG06F3/0604G06F3/0631G06F3/067G06F16/22G06F16/27
Inventor 邓志强李伟辉张欣黄子高周娟
Owner CHINA TELECOM CLOUD TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap