Cluster data processing method, device and equipment and storage medium

A technology of data processing and clustering, which is applied in the field of cloud storage, and can solve problems such as the impact of data migration progress and data repair progress, and the impact of client business data performance.

Active Publication Date: 2020-12-01
ZHEJIANG UNIVIEW TECH CO LTD
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when performing operations such as data migration and data repair, since data migration or data repair requires data processing resources, and the overall processing capacity of the system is fixed, it will not only affect the progress of data migration and data repair , and will also have an impact on the client's business data performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cluster data processing method, device and equipment and storage medium
  • Cluster data processing method, device and equipment and storage medium
  • Cluster data processing method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, only some structures related to the present invention are shown in the drawings but not all structures.

[0027] Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe various operations (or steps) as sequential processing, many of the operations (or steps) may be performed in parallel, concurrently, or simultaneously. In addition, the order of operations can be rearranged. The process may be terminated when its operations are complete, but may also have additional...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a cluster data processing method and device, equipment and a storage medium. The method comprises steps of determining data processing configuration information used in a current data processing period; executing data migration or data restoration operation according to the data processing configuration information, and determining resource use state information of a cluster; and determining new data processing configuration information according to the resource use state information of the cluster so as to load and use the new data processing configuration information when entering the next data processing period. The method is advantaged in that a use state of the cluster resources can be monitored in real time, used data migration or data repair strategy in the process of executing the data migration or data repair operation is dynamically adjusted according to the cluster resource use state to dynamically adjust the processing pressure between the data migration or data repair of the cluster and the service data of the client, so system resources of the cluster can be fully utilized.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of cloud storage, and in particular, to a cluster data processing method, device, device, and storage medium. Background technique [0002] With the continuous development of Internet technology and the explosive growth of information data, traditional data storage methods can no longer meet the growing data storage requests, so cloud storage services have been introduced. [0003] In distributed cloud storage, when resources are added, deleted, online, or offline in the cluster, operations such as data migration and data repair in the cluster will occur. However, when performing operations such as data migration and data repair, since data migration or data repair requires data processing resources, and the overall processing capacity of the system is fixed, it will not only affect the progress of data migration and data repair , and will also affect the business data performance of t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F11/07
CPCG06F3/061G06F3/0647G06F3/0629G06F3/067G06F11/0793
Inventor 石岩
Owner ZHEJIANG UNIVIEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap