Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed data storage method and device based on data feature pooling

A technology of distributed data and data characteristics, applied in the input/output process of data processing, electrical digital data processing, instruments, etc., can solve the problem of inability to perceive service data characteristics, increase the overall storage construction cost, and inability to adapt to services performance requirements and other issues to achieve the effect of improving data operation efficiency

Active Publication Date: 2021-07-06
BEIJING URBAN CONSTR INTELLIGENT CONTROL TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the logical pool splitting scheme is relatively simple, this scheme is unable to adapt to the performance requirements of the business and cannot perceive the data characteristics of the business, which means that this scheme cannot make the most reasonable optimization for different businesses. There are certain requirements, but the requirements are not very high. According to this pool division scheme, the business must be put into a high-performance pool, which increases the construction cost of the overall storage

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data storage method and device based on data feature pooling
  • Distributed data storage method and device based on data feature pooling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0041] Such as figure 1 As shown, it is a distributed data storage method based on data feature pooling in this embodiment, which includes the following steps:

[0042] In the feature division step, the fault domain algorithm is automatically pre-planned according to the characteristics of the business data, and the data is divided into different feature types; in this step, the data feature type parameters can be specified on the command line or when creating a pool on the client side.

[0043]The policy formulation step is to formulate distributed storage data optimization strategies for different feature types; this embodiment formulates two sets of data feature optimization for sequential features and random features in combination with the electrical characteristics of the hardware, the hardware performance of the server, and the operating system at the OSD level Strategy.

[0044] In the strategy loading step, the object storage device loads the corresponding data stora...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data storage method and device, belonging to the field of data storage, in particular to a distributed data storage method and device based on data feature pooling. Including: the feature division step, pre-planning the fault domain algorithm according to the characteristics of business data, the algorithm will automatically divide the data into different feature types; the strategy formulation step, formulating distributed storage data optimization strategies for different feature types; the strategy loading step, The storage device loads the corresponding data storage optimization strategy according to the data feature type of the sub-pool; in the optimization execution step, the object storage device executes the optimization operation according to the relevant actions defined by the data storage optimization strategy. Therefore, the present invention has the following advantages: the forward write performance of the node disk where the sequential feature pool is located is basically at full bandwidth, and the disk where the random feature pool is located also basically reaches the random performance of the limit, which significantly improves the data operation efficiency of distributed storage .

Description

technical field [0001] The invention relates to a data storage method and device, belonging to the field of data storage, in particular to a distributed data storage method and device based on data feature pooling. Background technique [0002] Distributed storage is a data storage technology. In simple terms, it is to disperse and store data on multiple storage servers, and form these dispersed storage resources into a virtual storage device. In fact, data is distributed and stored in each server. corner. [0003] Traditional network storage systems use centralized storage servers to store all data, and storage servers become the bottleneck of system performance and the focus of reliability and security. The distributed storage system uses multiple storage servers to share the storage load, and uses the location server to locate and store information, which effectively improves the reliability, availability and access efficiency of the system. [0004] At present, the dis...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0644G06F3/067
Inventor 刘立常海利冯东亮顾野
Owner BEIJING URBAN CONSTR INTELLIGENT CONTROL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com