Performance optimization method, device and equipment and computer readable storage medium

An optimization method and performance technology, applied in the communication field, can solve problems such as uneven pressure distribution of HDFS and degradation of HDFS reading performance, and achieve the effects of avoiding uneven pressure distribution, improving reading performance, and reducing pressure
CN111159131APending Publication Date: 2020-05-15ZTE CORP
3 Cites 4 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
ZTE CORP
Publication Date
2020-05-15

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a performance optimization method, device and equipment and a computer readable storage medium. The method comprises the steps: obtaining a data node where a data block corresponding to a data reading request is located after the data reading request transmitted by a client is received; obtaining a preset sorting strategy corresponding to the data nodes, and sorting the data nodes according to the sorting strategy to obtain a data node list; and returning the data node list to the client, so that the client determines a data node for providing a data block reading service according to the data node list. According to the invention, the client is prevented from always reading the data block from the data node closest to the client, the pressure of the data node closest to the client is reduced, the uneven pressure distribution of the HDFS is avoided, and the reading performance of the whole HDFS is improved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present invention relates to the technical field of communications, and in particular to a performance optimization method, device, equipment and computer-readable storage medium. Background technique

[0002] Hadoop is an open source distributed computing platform. Hadoop Distributed File System (Hadoop Distributed File System, HDFS) is a core component of Hadoop and is currently widely used in big data services. HDFS is mainly responsible for storing file data in Hadoop. Files on HDFS are stored in blocks. A data block is an abstraction that is a logical unit of file storage processing. A data block usually has multiple copies to increase data security, and multiple copies of the data block are usually stored in different data nodes, and these data nodes may be in the same rack or in different racks. When a client in HDFS wants to read a file, it usually prefers to read the copy of the data block in the data node closest to it, such as reading...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More