Data processing method and data processing device

A data processing and data block technology, applied in advanced technology, electrical components, sustainable buildings, etc., can solve the problems of heavy server load, affecting the speed of system data access, low data processing efficiency, etc., to reduce system energy consumption, ensure The effect of system access speed

Active Publication Date: 2013-10-23
NAT UNIV OF DEFENSE TECH
View PDF4 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to data-intensive calculations, the system will prioritize the allocation of computing logic to servers that store original data blocks (that is, data blocks obtained by direct segmentation) according to data processing requests. Only when the server that stores original data blocks appears When there is a failure, the calculation logic will be allocated to the server that stores the copy of the data block, so that some servers in the system will be heavily loaded, and the data processing efficiency will be low, which will affect the data access speed of the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and data processing device
  • Data processing method and data processing device
  • Data processing method and data processing device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0025] The embodiment of the invention discloses a data processing method to reduce resource waste and improve system resource utilization efficiency under the premise of ensuring normal data access of the system, so as to achieve the purpose of energy saving.

[0026] see figure 1 , shows a schematic flowchart of an embodiment of a data processing method of the present invention, the method of this embodiment is applied to a distributed storage system, especi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method and a data processing device. The data processing method is applied to a distributed storage system, the distributed storage system comprises a core server group and at least one periphery server group, wherein each of the core server group and the periphery server group comprises a plurality of data nodes used for storing and processing data, when the data nodes with larger data handling capacity are arranged in the core server group, at least one request for processing to be migrated is determined from a processing request to be processed in the core server group, and the request for processing to be migrated is transferred to the corresponding data nodes of the periphery server group, so that influence on normal data access of the system due to overlarge data handling capacity of some data nodes is avoided, and meanwhile, energy consumption of the system is minimized to save energy.

Description

technical field [0001] The present invention relates to the technical field of distributed shared storage, and more specifically relates to a data processing method and device. Background technique [0002] Cloud computing is a typical network computing model, emphasizing the scalability and availability of running large-scale applications in a virtual computing environment. With the rapid development of data-intensive computing and the gradual increase in the requirements for information processing capabilities, the data of data-intensive applications are more and more widely used in cloud computing environments. [0003] Data for data-intensive applications is generally stored in a distributed shared storage environment. In a distributed shared storage environment, in order to meet the data availability requirements of data-intensive applications, the data to be stored is generally divided into fixed-size data blocks, and a certain number of data block copies are copied f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCY02B60/33Y02D30/50
Inventor 杨树强贾焰周斌韩伟红韩毅李爱平尹洪赵辉陈志坤金松昌舒琦
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap