Unlock instant, AI-driven research and patent intelligence for your innovation.

Data write-in method and device

A data writing and data node technology, applied in the field of data processing, can solve the problems of low data writing success rate and efficiency, low utilization rate of storage resources, etc., so as to improve utilization rate, improve success rate and efficiency, and reduce waste Effect

Inactive Publication Date: 2015-12-30
ZHEJIANG UNIVIEW TECH CO LTD
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The present invention provides a data writing method and device to solve the problems of low success rate and efficiency of data writing and low utilization rate of storage resources in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data write-in method and device
  • Data write-in method and device
  • Data write-in method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, and to make the above-mentioned purposes, features and advantages of the embodiments of the present invention more obvious and understandable, the following describes the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings For further detailed explanation.

[0023] In order to make those skilled in the art better understand the technical solutions provided by the embodiments of the present invention, the network architecture applicable to the embodiments of the present invention will be described below first.

[0024] See figure 1 , figure 1 It is a schematic diagram of a data writing network architecture provided by an embodiment of the present invention. like figure 1 As shown, the schematic diagram of the network architecture may include a NameNode, a DataNode, and a client (...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data write-in method and device. The method comprises the steps that a data node obtains the available state of a local storage resource and maintains an available resource list and an unavailable resource list according to the available state of the local storage resource; when the available state of the local storage resource is changed from 'unavailable' to 'available', the local storage resource is added to the available resource list; when the data node receives a data write-in request sent by a client end, a target storage resource used for data write-in is selected from the available resource list, and data write-in is conducted on the target storage resource. By means of the data write-in method and device, the success rate of data write-in can be raised, efficiency of data write-in can be improved, and the utilization rate of the stored resource is raised.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data writing method and device. Background technique [0002] HDFS (Hadoop Distributed File System, Hadoop Distributed File System) is a master / slave (Master / Slave) architecture. An HDFS cluster consists of a NameNode and multiple DataNodes. NameNode is a metadata node that manages the metadata of the file system, and DataNode is a data node that stores actual file data. [0003] The DataNode of the HDFS cluster needs to be configured with multiple storage resources. When DataNode is initialized, all resource lists are loaded into the memory. When DataNode writes data, it selects storage resources according to the following rules: [0004] 1), Polling all storage resources in the configuration file; [0005] 2). Sort all the storage resources in the configuration file according to the remaining capacity, and select the storage resource with the largest remaining capac...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/13G06F16/1737G06F16/182
Inventor 张敏
Owner ZHEJIANG UNIVIEW TECH CO LTD