A cache control method, device, and computer-readable storage medium
A cache control and caching technology, applied in the Internet field, can solve problems affecting reading performance and writing performance
Active Publication Date: 2020-11-10
MIGU MUSIC CO LTD +1
View PDF3 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
When the data in BlockCache is full, it needs to be obtained through StoreFile, and reading data from StoreFile is more expensive than reading data directly from BlockCache, thus greatly affecting the reading performance
When the data in MemStore is full, the cached data will be automatically written to StoreFile through the flush operation. Since the number of times of flushing into hdfs is greatly increased, the writing performance will be greatly affected.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0044] In related technologies, with the advent of the era of big data, in the face of the ever-increasing mass of data, the disadvantages of traditional centralized databases are becoming more and more obvious. In order to ensure high reliability of data, distributed databases often adopt backup strategies to achieve fault tolerance, so , when reading data, the client can concurrently read from multiple backup servers at the same time, thus improving the data access speed. A distributed database can achieve linear expansion of storage capacity by adding storage nodes. Since a distributed database uses multiple hosts to form a storage cluster, it can provide higher concurrent user visits than a centralized database. Therefore, distributed databases have become more commonly used databases at present.
[0045]In a distributed database, the traditional file storage hdfs (Hadoop Distributed File System, distributed file system) system uses the way of reading and writing files to...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present invention discloses a cache control method. The method comprises: acquiring a first read amount that is stored in a read cache within a historical unit time period, and a first write amount that is stored in a write cache within a historical unit time period; comparing the first read amount with the first write amount to obtain a comparison result; according to the comparison result, determining a cache whose storage ratio is to be updated; using the first read amount and the first write amount, the pre-determined estimated read amount of the read cache and the estimated write amount of the write cache to determine the storage ratio corresponding to the cache whose storage ratio is to be updated, wherein the storage ratio characterizes the memory usage of the cache whose storage ratio is to be updated when the read / write demand is satisfied; and updating the memory usage of the cache whose storage ratio is to be updated by using the determined storage ratio. The present invention also discloses a cache control device and a computer readable storage medium.
Description
technical field [0001] The present invention relates to the technical field of the Internet, in particular to a cache control method, device and computer-readable storage medium. Background technique [0002] At present, with the rapid increase of data volume and the rapid development of data mining technology, distributed databases have become more commonly used databases due to their higher data access speed and high reliability in the face of growing massive data. [0003] Currently, the distributed database HBase includes: BlockCache (read cache), MemStore (write cache), StoreFile (HFile) (disk file). When the data in BlockCache is full, it needs to be obtained through StoreFile, and the overhead of reading data from StoreFile is higher than directly reading data from BlockCache, thus greatly affecting the reading performance. When the data in the MemStore is full, the cached data will be automatically written to the StoreFile through the flush operation. Since the numb...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F12/0804
CPCG06F12/0804
Inventor 张开威张弛
Owner MIGU MUSIC CO LTD