Data processing method and device

A data processing and data technology, applied in the direction of electrical digital data processing, data processing input/output process, instruments, etc., to facilitate data query and avoid writing hot spots
CN110968256AInactive Publication Date: 2020-04-07HUAWEI TECH CO LTD
3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN Β· China
Patent Type
Applications(China)
Current Assignee / Owner
HUAWEI TECH CO LTD
Publication Date
2020-04-07
Estimated Expiration
Not applicable Β· inactive patent

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a data processing method and device. The method may include: providing a plurality of sensors; the first calculation node receives a write-in command sent by the client, the first calculation node computes a corresponding relation between the calculation node and a file according to a routing view of a range partitioning algorithm; determining a first file corresponding tothe first data, the first calculation node calculates the first data according to the first data, storing to the first file; the first calculation node computes a file according to the corresponding relationship between the calculation node and the file; determining a second file corresponding to the first calculation node, and the first calculation node acquires second files stored by other calculation nodes except the first calculation node, and the first calculation node stores the acquired second files of the other calculation nodes, so that the problem that the calculation nodes write hotspots can be avoided, and the data reading rate is ensured.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present application relates to the technical field of data storage, and in particular to a data processing method and device. Background technique

[0002] Such as figure 1 As shown, the distributed storage system may include the following parts: client, computing node and storage node. The process of writing data is as follows: the user inputs data to the client, and the client uses the range partitioning algorithm or hash partitioning algorithm to allocate the input data to the corresponding computing nodes, and then the corresponding computing nodes The node executes the write operation and writes to the corresponding storage node.

[0003] If the range partitioning algorithm is used, the written data is from A0 to A99, the number of computing nodes is 3, and the routing view of the range partitioning is: A0β€”A32 β†’ computing node 1, A33β€”A65 β†’ computing node 2, A66β€”A99 β†’ computing node 3. Using the range partitioning algorithm may cause write ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More