Cache refreshing method and device, electronic equipment and storage medium

A technology for caching and caching data, applied in the field of data processing, which can solve the problems of untimely log recycling and current limiting.

Active Publication Date: 2021-09-24
SUGON INFORMATION IND
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of this, the purpose of the embodiment of the present application is to provide a cache refresh method, device, electronic equ

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cache refreshing method and device, electronic equipment and storage medium
  • Cache refreshing method and device, electronic equipment and storage medium
  • Cache refreshing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

[0043] According to the applicant's research, it is found that in the process of recovering logs from the resource space of the log disk and performing cache refresh, the log module mainly provides high availability for metadata, so that metadata nodes can No data loss due to data not being written to the backend. Among them, the main log node is responsible for receiving the logs submitted by the business layer, aggregating the submitted log data, leading the curing operation of the logs, and applying the log data to the cache and other operations. When the consistency of each log node is maintained, the log will be solidified and written to the local log disk, and the space of the log disk is limited. When new logs need to be written repeatedly, invalid logs need to be recovered in time to release...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a cache refreshing method and device, electronic equipment and a storage medium, and relates to the technical field of data processing. The method comprises the following steps: determining a resource pressure, wherein the resource pressure comprises a log disk utilization rate; determining a cache back-brushing rate based on the resource pressure; and on the basis of the cache back-brushing rate, performing cache back-brushing on a specified data block associated with a specified log in a back-brushing queue and front M data blocks and rear N data blocks of the specified data block, wherein both M and N are positive integers. According to the method, resource recovery and resource pressure are associated, the back-end I/O aggregation rate is adjusted according to the resource pressure, the throughput demand when the resource pressure is large and the I/O aggregation efficiency when the resource pressure is low can be guaranteed, meanwhile, it is guaranteed that log resource recovery is effectively triggered by each time of back-brushing according to the sequence back-brushing of the data blocks associated with the log, and then the recovery efficiency of the log resources is stabilized.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular, to a cache refresh method, device, electronic equipment, and storage medium. Background technique [0002] In the existing log reclamation and corresponding cache refresh technology, the cache puts it into the refresh queue when the object is first dirty, waits for the back-end thread to refresh, and records the time stamp of the object being dirty; the refresh thread checks regularly Cache pressure and refresh queue. When the cache pressure is high or an object is dirty for more than a certain time threshold, the refresh is triggered. Objects whose dirty time exceeds the threshold are refreshed in order of timestamp. After the refresh is completed, the upper layer is notified to clean up the logs and Associated resources. [0003] Based on the above-mentioned existing technical conditions, when the resource pressure of the log disk is high, the constant refr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50
CPCG06F9/5016G06F9/5022Y02D10/00
Inventor 刘敏马照云李晓格李兆龙
Owner SUGON INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap