Data reading method and device and distributed storage system

A data reading and data technology, which is applied in the direction of electrical digital data processing, data processing input/output process, instruments, etc., can solve the problems of heavy load on the master copy server, waste of server resources, etc., to solve the waste of resources, realize The effect of load balancing and improving data reading efficiency

Inactive Publication Date: 2017-02-22
LETV HLDG BEIJING CO LTD +1
View PDF3 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The data reading method provided by the embodiment of the present invention can solve the problems of waste of resources of the server where the backup copy is located and overloading of the server where the primary copy is located, caused by the fact that the server where the primary copy is located is responsible for data reading.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data reading method and device and distributed storage system
  • Data reading method and device and distributed storage system
  • Data reading method and device and distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] Such as figure 1 As shown, an embodiment of the present invention provides a method for reading data, wherein the data includes multiple copies, the multiple copies are divided into a primary copy and a backup copy, and the multiple copies are respectively stored in different servers , the method includes the following steps:

[0042] S1: The server where the master copy is located receives the user's data read request;

[0043] Among them, the server where the master replica is located is responsible for receiving user requests. After receiving the user request, it first judges whether it is a read request, and if it is a read request, proceed to the subsequent steps.

[0044] S2: According to the load information of the server where all the replicas are located, select the server where the replica with the smallest load is located;

[0045]It should be noted that the server where the master copy is located has a load collection module, and each server where the copy...

Embodiment 2

[0052] Such as figure 2 As shown, another embodiment of the present invention provides a kind of data reading method, and this method comprises the following steps:

[0053] S1: The server where the master copy is located receives the user's data read request;

[0054] Among them, the server where the master replica is located is responsible for receiving user requests. After receiving the user request, it first judges whether it is a read request, and if it is a read request, proceed to the subsequent steps.

[0055] S2: According to the load information of the server where all the replicas are located, select the server where the replica with the smallest load is located;

[0056] It should be noted that the server where the master copy is located has a load collection module, and each server where the copy is located (the server where the master copy is located and the server where the backup copy is located) is equipped with a load reporting module, which is responsible ...

Embodiment 3

[0061] Such as image 3 As shown, another embodiment of the present invention provides a data reading method, the method includes the following steps:

[0062] S1: The server where the master copy is located receives the user's data read request;

[0063] Among them, the server where the master replica is located is responsible for receiving user requests. After receiving the user request, it first judges whether it is a read request, and if it is a read request, proceed to the subsequent steps.

[0064] S201: Collect load information of servers where all copies are located, wherein the servers where all copies are located report the load information of the server at preset time intervals;

[0065] Wherein, the load information includes CPU load, remaining memory, network traffic and disk utilization within a preset time.

[0066] It should be noted that the server where the master copy is located is equipped with a load collection module, and the servers where each copy is ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data reading method and device and a distributed storage system. The data reading method comprises the steps that a server where a primary copy is located receives a data reading request of a user; the server where a copy with the smallest load is located is selected according to load information of servers where all copies are located; if the server where the primary copy is located is not the server with the smallest load, the data reading request is sent to a server where a standby copy with the smallest load is located, so that data reading operation is carried out; data read by the server where the standby copy with the smallest load is located is received and shown to the user. According to the technical scheme, the server where the copy with the smallest load is located is selected for data reading operation, data reading operation is not all carried out by the server where the primary copy is located, therefore, load balance of the servers where the copies are located can be achieved, data reading efficiency is improved, and the problems of resource waste of the server where the standby copy is located and too heavy loads of the server where the primary copy is located in the prior art are solved.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of computer data processing, and in particular, to a data reading method, device, and distributed storage system. Background technique [0002] The distributed storage system divides the data according to certain rules and stores them scatteredly on multiple independent general-purpose storage servers. In a distributed storage system, in order to make the data as uniform as possible, a large file is usually divided into multiple smaller files for storage. For example, a 512MB file is divided into 128 sub-files of 4MB, and the 128 sub-files are divided according to Writing the file mapping rules to different disks is obviously better than writing all 512MB to the same disk, because it can prevent certain disks from becoming hotspots and bottlenecks in cluster performance when reading and writing data. [0003] The traditional network storage system uses a centralized storage server to s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0607G06F3/0635G06F3/067
Inventor 吴兴义
Owner LETV HLDG BEIJING CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap