Data reading method and data reading system capable of relieving disk reading bottleneck
A data reading and disk technology, applied in transmission systems, electrical components, etc., can solve problems such as excessive idle time, over-frequency disk reading operations, and disk IO bottlenecks, so as to improve usage efficiency and reduce disk read IO problems. , the effect of reducing the frequency
Active Publication Date: 2013-01-30
华数传媒网络有限公司 +1
View PDF4 Cites 13 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] The purpose of the present invention is, on the one hand, it can overcome the problem of over-frequency disk reading operation caused by frequent moving of the magnetic head when the network file sending server adopts multithreading to concurrently read multiple files; The problem of too much idle time for reading operations, thereby providing a method and system for multi-threaded concurrent reading of multiple files, that is, the present invention provides a method and system for data reading that alleviates disk reading bottlenecks
[0005] The technical scheme of the present invention can effectively solve the disk IO bottleneck problem caused when the network file sending server adopts multithreading to concurrently read multiple files
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0051] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.
[0052] The present invention provides an algorithm for solving the IO bottleneck caused by multi-threaded concurrent reading of multiple files. After using this method, the problem of disk IO bottleneck can be reduced or completely eliminated, and the processing capacity of the data sending service program can be improved at the same time, thereby To achieve the purpose of improving system service capabilities and enhancing user experience.
[0053] The basic idea of the present invention is to save the disk data in the physical memory of the system in advance, and at the same time make full use of the idle time of the disk data reading operation, and use the intelligent prediction algorithm to pre-schedule the data that has not been requested by the end user from the disk to the system memory for storage , the disk data read operation conges...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a data reading method and a data reading system capable of relieving disk reading bottle neck. The data reading method is used for processing P2P (peer to peer) type data requests of users through a network file sending server and includes: the step 101, a user sends a data block request to the network file sending server; the step 102, a prestored data block sequence which contains data blocks and is N times of the length of the data block requested by the user is stored into an internal memory from a disk by the network file sending server; and the step 103, the network file sending server hits the data blocks required by the user through the internal memory and sends the data blocks to the user, wherein the N is a positive integer larger than one. When the data block sequence stored in the internal memory is about to be extracted by the user, a predict data block on the disk is stored into the internal memory in advance in a disk reading free time by a prediction process. By the data reading method, each movement of a magnetic head is utilized sufficiently, reading frequency of the disk is reduced, and free time in IO (input / output) operation of the disk is utilized.
Description
technical field [0001] The invention relates to an algorithm for solving the problem of the disk IO bottleneck affecting service output flow caused by the high wa value of the CPU of the operating system caused by multi-threaded concurrent reading of multiple files. The CPU of the network file sending server in the application scenario where the protocol provides small block data sending services, the scheme of the present invention adopts a method and system for concurrently reading multiple files with multiple threads, that is, the present invention provides a data reading method that alleviates the bottleneck of disk reading. methods and systems for extraction. Background technique [0002] The network file sending server refers to the equipment used to provide data push service in the cache system, and the network file sending service refers to the service for Internet terminal users, which provides data sending services such as file download and video on demand through ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): H04L29/08
Inventor 鲁冬林董博
Owner 华数传媒网络有限公司