Cache heating method and device, computer equipment, readable storage medium and program product
By detecting the cache ratio of incremental files and performing heating actions, the problem of slow random reading speed during incremental backup is solved, and the backup rate and efficiency are improved.
Patent Information
- Application Number
- CN202411898123.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-20
- Publication Date
- 2025-04-18
AI Technical Summary
During the incremental backup process, random reading of non-continuous data is slow, and the operating system's file caching mechanism is not targeted for incremental backup scenarios, resulting in some incremental data being re-read from external storage, affecting the backup speed.
By querying the incremental file list, detect the cache ratio of the incremental file, and perform a heating action when the cache ratio is lower than the preset threshold, reload the uncached incremental file into memory, ensuring that the cache ratio remains at the preset level.
Increases the rate of incremental backups, reduces dependence on external storage media, and ensures efficient backup processes.
Smart Images
Figure CN119847819A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of big data technology, and in particular to a heating cache method, device, computer equipment, readable storage medium and program product. Background Art
[0002] In order to ensure data security, the database is usually backed up to the backup warehouse regularly or manually. In order to reduce the amount of data that needs to be processed during backup, the traditional technology adopts the incremental backup method, that is, first a full backup of the database is performed, and the data file path and data block information that have changed since the last backup are recorded during the operation of the database; in the subsequent backup process, only the changed data is backed up; in the recovery process, based on the earliest full backup, combined with each subsequent incremental backup, the final full backup is generated for recovery.
[0003] At the operating system level, the most recently read or written file data of various upper-level systems, including the database, will be cached in the memory to increase the subsequent access speed to the same file. Older cached files that have not been accessed for a period of time will be gradually replaced.
[0004] In the above solution, although incremental backup can reduce the amount of data that needs to be backed up each time, due to the uncertainty of the business and the purpose of protecting the storage medium, the storage of incremental data on the storage medium is usually non-continuous. Therefore, during the incremental backup process, there is a problem of slow random reading speed when reading non-continuous data, and sufficient cache is required to increase the backup rate. In addition, the file cache mechanism of the operating system is not targeted at incremental backup scenarios, and lacks targeted processing for scheduled (for example, daily) incremental backup actions. When performing incremental backup, some incremental data may have been cleared from the memory and need to be read and loaded from the slower external storage again, which affects the overall backup speed. Summary of the invention
[0005] The embodiments of the present application provide a heating cache method, apparatus, computer equipment, readable storage medium and program product to achieve the effect of improving the incremental backup speed.
[0006] In a first aspect, an embodiment of the present application provides a heating cache method, comprising:
[0007] Querying the incremental file list; wherein the incremental file list is generated by the database responding to the incremental backup start instruction and synchronously recording the paths of the changed files;
[0008] Detecting the cache ratio of the incremental files in the incremental file list;
[0009] When the cache ratio meets a preset condition, a heating action is performed to heat the cache of the incremental files in the incremental file list.
[0010] In a possible implementation, the method further includes:
[0011] At preset intervals, the cache ratio of the incremental files in the incremental file list is periodically detected.
[0012] In a possible implementation, detecting the cache ratio of the incremental files in the incremental file list includes:
[0013] Randomly sampling a first preset proportion of file paths in the incremental file list to obtain a plurality of candidate incremental files;
[0014] Detect cache ratios of multiple candidate incremental files, and use the cache ratios as cache ratios of incremental files in the incremental file list.
[0015] In a possible implementation, detecting cache ratios of multiple candidate incremental files includes:
[0016] For each of the candidate incremental files, randomly selecting a second preset proportion of data points;
[0017] The proportion of data points cached in the memory among all data points is detected to obtain the cache proportions of multiple candidate incremental files.
[0018] In a possible implementation, the performing a heating action to heat and cache the incremental files in the incremental file list includes:
[0019] Traverse the incremental file list, obtain each incremental file, and confirm whether each incremental file is cached in the memory;
[0020] For the cached incremental file, access or operate the incremental file;
[0021] For the incremental files that are not cached, read the external storage medium and reload the incremental files into the cache.
[0022] In a possible implementation manner, a determination method of satisfying a preset condition includes:
[0023] If the cache ratio is less than a preset threshold, it is considered that the preset condition is met.
[0024] In a second aspect, an embodiment of the present application provides a heating cache device, including:
[0025] A list generation module, used to respond to the database to start the incremental backup instruction, synchronously record the path of the changed file, and generate an incremental file list;
[0026] A detection module, used to detect the cache ratio of the incremental files in the incremental file list;
[0027] A heating module is used to perform a heating action to heat and cache the incremental files in the incremental file list when the cache ratio meets a preset condition.
[0028] In a third aspect, an embodiment of the present application provides a computer device, including: a memory, a processor;
[0029] The memory stores computer-executable instructions;
[0030] The processor executes the computer-executable instructions stored in the memory, so that the processor executes the above first aspect and / or various possible implementations of the first aspect.
[0031] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the first aspect above and / or various possible implementations of the first aspect.
[0032] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the above first aspect and / or various possible implementation methods of the first aspect.
[0033] The embodiments of the present application provide a heating cache method, device, computer equipment, readable storage medium and program product, which generates an incremental file list by synchronously recording the path of the changed files in response to the incremental backup instruction of the database; detecting the cache ratio of the incremental files in the incremental file list; and performing a heating action to heat and cache the incremental files in the incremental file list when the cache ratio meets the preset conditions. When performing scheduled incremental backup, the present application ensures that the cache ratio of the incremental files is maintained at a preset level, without the need to read a large amount of external storage media, thereby improving the backup rate. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0035] Figure 1 A schematic diagram of the structure of a data backup system in one embodiment;
[0036] Figure 2A schematic diagram of a heating cache method in one embodiment;
[0037] Figure 3 A schematic diagram of a flow chart of a step of detecting an incremental file cache ratio in one embodiment;
[0038] Figure 4 A schematic diagram of a flow chart of a step of detecting a cache ratio of a candidate incremental file in one embodiment;
[0039] Figure 5 A schematic diagram of a flow chart of a heating step in an embodiment;
[0040] Figure 6 It is a structural block diagram of a heating cache device in one embodiment;
[0041] Figure 7 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment.
[0042] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0043] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0044] See also Figure 1 An embodiment of the present application provides a data backup system, which includes: a database, a backup warehouse, an operating system, a memory, an external storage medium and a heating cache device.
[0045] The database is used to store files generated by external applications during operation, including logs, configurations, data files, etc. The database can provide efficient query and write operations for external applications, facilitating unified management and retrieval.
[0046] The backup warehouse is used to back up the files stored in the database to ensure the safety of the files and to ensure that the data can be restored in the event of a disaster. Furthermore, in the embodiment of the present application, an incremental backup method is adopted to save the files in the database to the backup warehouse.
[0047] The operating system is responsible for managing computer hardware resources, such as CPU, memory, storage devices, etc. In this embodiment, it is mainly used to cache the files recently read or written by the database in the memory to improve the subsequent access speed to the same file.
[0048] Memory, used to temporarily store files recently read or written by the database.
[0049] The external storage medium is used to persist the files in the database; the external storage medium includes a hard disk (HDD), a solid state drive (SSD), a network attached storage (NAS), etc. When the files in the memory are cleared from the memory cache due to insufficient memory or long-term non-access, the operating system will read the files from the external storage medium again.
[0050] A heating cache device is used to query the incremental file list, detect the cache ratio of the incremental files in the incremental file list, and perform a heating action to heat the incremental files in the incremental file list when the cache ratio meets the preset conditions. The incremental file list is generated by the database in response to the incremental backup start instruction, and the path of the changed files is synchronously recorded. In addition, the above-mentioned start instruction can be manually triggered by the user or automatically triggered based on a preset task.
[0051] Furthermore, the database provides an interface for the heating cache device to query the above-mentioned incremental file list.
[0052] Furthermore, the operating system also provides an interface for the heating cache device to detect the cache ratio of the incremental files in the incremental file list through the operating system.
[0053] In the above data backup system, after receiving the incremental backup start instruction, the database will synchronously record the path of the changed files based on the previous backup and generate an incremental file list. The heating cache device queries the incremental file list, and if the cache ratio of the file meets the preset conditions, the incremental file is heated to maintain the cache ratio of the incremental file at a preset level, so that the operating system does not need to read a large amount of external storage media when reading files, thereby improving the backup rate.
[0054] See also Figure 2 In one embodiment, the present application provides a heating cache method, the heating cache method comprising:
[0055] Step 202, query the incremental file list; wherein the incremental file list is generated by the database in response to the incremental backup start instruction, synchronously recording the paths of the changed files.
[0056] Specifically, the incremental backup of the database is usually performed according to a preset trigger mechanism, and its start instruction can be manually triggered or automatically triggered. For example, in MySQL, the mysqldump tool can be used in conjunction with the binary log (Bin Log) to implement incremental backup. Users need to run these commands manually or call these commands through scripts when needed. In Windows systems, you can use the task scheduler to execute backup scripts regularly. These scheduled tasks can be configured to run automatically at specific times without human intervention.
[0057] When the incremental backup task is started, the database will receive the corresponding start instruction, which carries the instruction type. After the database recognizes that the instruction type is incremental backup, it loads the relevant metadata, which includes the time point of the last backup. Furthermore, the database compares the file status of the last backup, tracks which files have changed, and records the file change information, which includes the file change path, change time, file type, file size, etc. The database generates an incremental file list based on the above change information.
[0058] Step 204: Detect the cache ratio of the incremental files in the incremental file list.
[0059] Specifically, a database is a logical storage management system that stores structured or semi-structured data, usually in special formats such as B-trees and log files. Data can only be accessed through query statements or dedicated interfaces and cannot be directly used as a source for operating system file reading.
[0060] The backup repository is usually in incremental or compressed form and may be stored in a non-real-time manner, making it unsuitable for direct real-time file access.
[0061] The external storage medium stores the original file data or the underlying data files of the database, and the external storage medium is directly mounted with the operating system interface. The operating system can quickly access the files in the external storage medium through the file system without additional decompression, decryption or parsing operations.
[0062] Operating systems usually cache frequently accessed data in memory to reduce data access latency. However, when memory is insufficient or has not been accessed for a long time, files in memory may be cleared from the memory cache; in addition, when the device is powered off, the files in memory will be completely lost. When the above situation occurs, the operating system will reload the lost files from the external storage medium into the memory.
[0063] The embodiment of the present application detects whether the target file is cached in the memory through the operating system.
[0064] Step 206: When the cache ratio meets the preset condition, a heating action is performed to heat the cache of the incremental files in the incremental file list.
[0065] Specifically, the cache ratio refers to the ratio of incremental files cached in memory to all incremental file data, which has a significant impact on data access speed. If the read file is cached in memory, there is no need to access the slower external storage medium, and it can be read directly from the memory, and its reading speed is usually in microseconds.
[0066] Performing a heating action on an incremental file refers to preprocessing the incremental file to make it easier to access or operate. Specifically in this embodiment, performing a heating action on an incremental file includes loading the incremental file into memory. Furthermore, performing a heating action on an incremental file also includes processing the incremental file, such as decompressing, decrypting, decoding, or format conversion of the incremental file; performing consistency checks on the incremental file to ensure that the file content is complete and not damaged; generating or updating indexes for incremental files to support fast search and access; and dynamically managing which incremental files need to be cached and which can be cleared from the cache based on access frequency or priority.
[0067] Optionally, the above-mentioned determination method of satisfying the preset conditions includes:
[0068] If the cache ratio is less than the preset threshold, it is considered that the preset condition is met.
[0069] Specifically, if most incremental files have been cached in memory, then when performing data processing operations such as analysis, statistics, and index creation, it is only necessary to read data directly from the memory, which can greatly improve processing efficiency. However, a low cache ratio will lead to frequent reading from external storage media, which will extend the data processing time, especially when large-scale data is processed. It should be noted that the preset threshold can be set according to the actual business of data processing, and the embodiments of the present application do not limit its specific value.
[0070] The above-mentioned cache heating method obtains the cache ratio of the incremental files in the incremental file list by querying the database in response to the incremental backup start instruction and synchronously recording the paths of the changed files, and heats the incremental files when the cache ratio meets the preset conditions to maintain the cache ratio of the incremental files at a preset level. In this way, when reading files, there is no need to read a large amount of external storage media, thereby improving the backup rate.
[0071] Optionally, the heating cache method provided in the embodiment of the present application further includes:
[0072] At preset intervals, periodically check the cache ratio of incremental files in the incremental file list.
[0073] Specifically, frequent detection actions will occupy system resources, affect system performance, and interfere with normal business processes. Based on this, the embodiment of the present application periodically performs detection actions based on a preset time. In another embodiment, a combination of real-time detection and periodic detection can also be performed. For example, by predicting the data access model, there will be a data access peak in a specific time period. At this time, the real-time detection method can be performed in the specific time period, and the periodic detection method can be performed in the remaining time periods.
[0074] The above-mentioned heating cache method periodically performs detection actions, which can reduce interference with normal business processes and reduce the impact on system performance.
[0075] See also Figure 3 Optionally, detecting the cache ratio of the incremental files in the incremental file list includes:
[0076] Step 302: Randomly sample a first preset proportion of file paths in the incremental file list to obtain multiple candidate incremental files.
[0077] Step 304: Detect cache ratios of multiple candidate incremental files, and use the cache ratios as cache ratios of incremental files in the incremental file list.
[0078] Specifically, to detect the cache status of all incremental files in the incremental file list, it is necessary to traverse the entire rectified file list. When there are many incremental files, it takes a lot of time and may even interfere with system performance, which is costly. Generally speaking, in most scenarios, the cache status of some files is sufficient to reflect the overall cache status. Random sampling can quickly locate whether there is a problem of insufficient cache without wasting resources to detect each file.
[0079] Furthermore, according to the first preset ratio, the incremental files are randomly sampled to quickly obtain the cache ratio estimation value; if the cache hit rate is low, the first preset ratio can be appropriately increased; accordingly, if the cache hit rate is high enough, the first preset ratio can be gradually reduced until the cache hit rate meets the detection requirements. For example, in the embodiment of the present application, the initial value of the first preset ratio is set to 10%.
[0080] Furthermore, random sampling can be performed in incremental files of different categories according to the category or importance of the incremental files, and the values of the first preset ratios of different categories can be different. In this way, the hit rate of detection can be improved through stratified sampling.
[0081] The above-mentioned heating cache method randomly samples incremental files in the incremental file list according to the first preset ratio, and uses the cache ratio of the randomly sampled incremental files as the overall cache ratio. In this way, it is possible to quickly locate whether there is a problem of insufficient cache and improve detection efficiency.
[0082] See also Figure 4 Optionally, detecting cache ratios of multiple candidate incremental files includes:
[0083] Step 402: For each candidate incremental file, randomly select a second preset proportion of data points.
[0084] Step 404: Detect the proportion of data points cached in the memory among all data points, and obtain the cache proportions of multiple candidate incremental files.
[0085] Specifically, a data point refers to a certain position or data block in an incremental file. By setting marks at these positions or data blocks, it is possible to detect whether they are cached in memory by the operating system. Furthermore, when data points are randomly set, different areas of the incremental file can be covered, thereby avoiding detection being limited to a specific part and providing a more representative cache state. Furthermore, the value of the second preset ratio can be set as needed and can be gradually adjusted according to the hit rate of the cache ratio. Exemplarily, the initial value of the second preset ratio in the embodiment of the present application is set to 20%. If the hit rate is high, the value of the second preset ratio can be appropriately reduced, otherwise the value of the second preset ratio can be appropriately increased.
[0086] The reason why data points are detected in the embodiments of the present application, rather than the entire incremental file, is that detecting the entire file will take up a lot of memory and CPU resources. In addition, detecting the entire incremental file can only know the overall cache status, such as full cache or partial cache, while detecting data points can observe the cache status of different areas. Furthermore, more data points can be set in hot areas and fewer data points in unpopular areas, so as to obtain the cache status distribution of incremental files in a timely manner.
[0087] Detecting whether a data point is cached in memory is achieved through the operating system. Generally speaking, the operating system manages memory and cache through a series of complex mechanisms, which can record all memory access requests and track which files are loaded into the cache. The operating system has multiple ways to confirm whether a data point is cached in memory. For example, the operating system maintains a memory mapping table for converting virtual addresses to physical addresses; through this mapping table, the operating system can know which virtual addresses correspond to data blocks that are currently cached in memory. In addition, the cache in the computer usually has a tag storage function to record which data blocks are currently cached in the cache; when a data point is accessed, the operating system can check the cache tag to determine whether the data has been cached.
[0088] Through the above steps, the operating system can detect each data point one by one to confirm whether each data point is cached in the memory, thereby obtaining a ratio value. For example, if the total number of data points set is 1000 and 300 are cached in the memory, the cache ratio is considered to be 30%.
[0089] The above-mentioned heating cache method randomly selects data points in each candidate incremental file according to the second preset ratio, and detects whether each data point is cached in the memory in turn. While quickly obtaining the cache status distribution of the incremental file, it further reduces the detection overhead and saves resources.
[0090] See also Figure 5 Optionally, a heating action is performed to heat and cache the incremental files in the incremental file list, including:
[0091] Step 502: traverse the incremental file list, obtain each incremental file, and confirm whether each incremental file is cached in the memory.
[0092] Step 504: Access or operate the cached incremental file.
[0093] Step 506: For the incremental file that is not cached, read the external storage medium and reload the incremental file into the cache.
[0094] Specifically, when the cache ratio is less than the preset threshold, it is considered that the cache ratio is low, which affects the speed at which the system processes data. In this way, a heating action is performed on each incremental file in the incremental file list to maintain the incremental file at a higher cache ratio. This eliminates the need to read a large amount of external storage media, thereby improving the backup rate.
[0095] Furthermore, for cached incremental files, the heating action can increase the access frequency to keep them in an active state, thereby extending the cache validity. In addition, the priority of the incremental file can be adjusted to improve its position in the memory and extend the cache validity.
[0096] For uncached incremental files, the heating action is to read the external storage medium through the IO system and reload the incremental files into the cache. Based on the periodic heating strategy of this solution, the overall ratio of such uncached data can be maintained at a low level.
[0097] The above-mentioned heating cache method performs a heating action on the incremental files in the incremental file list when the cache ratio of the incremental files in the incremental file list is lower than a preset threshold value, so as to extend the cache validity of the cached incremental files, and at the same time read the uncached incremental files from the external storage medium into the internal memory. The present application maintains the incremental files at a higher cache ratio, so that a large amount of external storage media does not need to be read during data processing, thereby improving the backup rate.
[0098] In order to enable those skilled in the art to fully understand the present application, the steps of the heating cache method of the present application are described in detail below:
[0099] The present application periodically queries the incremental file list; wherein the incremental file list is generated by the database in response to the incremental backup start instruction, synchronously recording the paths of the changed files.
[0100] Furthermore, the present application detects the cache ratio of incremental files in the incremental file list, including: randomly sampling a first preset ratio of file paths in the incremental file list to obtain multiple candidate incremental files; for each candidate incremental file, randomly selecting a second preset ratio of data points; detecting the ratio of data points cached in the memory among all data points to obtain the cache ratio of multiple candidate incremental files; and using the cache ratio as the cache ratio of the incremental files in the incremental file list.
[0101] When the cache ratio meets the preset conditions, a heating action is performed to heat and cache the incremental files in the incremental file list, including: traversing the incremental file list, obtaining each incremental file, and confirming whether each incremental file is cached in the memory; for the cached incremental file, accessing or operating the incremental file; for the uncached incremental file, reading the external memory storage medium, and reloading the incremental file into the cache. If the cache ratio is less than the preset threshold, it is considered that the preset conditions are met.
[0102] The above-mentioned cache heating method obtains the cache ratio of the incremental files in the incremental file list by querying the database in response to the incremental backup start instruction and synchronously recording the paths of the changed files, and heats the incremental files when the cache ratio meets the preset conditions to maintain the cache ratio of the incremental files at a preset level. In this way, when reading files, there is no need to read a large amount of external storage media, thereby improving the backup rate.
[0103] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0104] Based on the same inventive concept, the embodiment of the present application also provides a heating cache device for implementing the heating cache method involved above. The implementation solution provided by the device to solve the problem is similar to the implementation solution recorded in the above heating cache method, so the specific limitations in one or more device embodiments provided below can refer to the limitations of the heating cache method above, and will not be repeated here.
[0105] See also Figure 6 In one embodiment, the present application provides a heating cache device 60 , including: a list generation module 601 , a detection module 602 and a heating module 603 .
[0106] The list generation module 601 is used to respond to the database start incremental backup instruction, synchronously record the path of the changed file, and generate an incremental file list.
[0107] The detection module 602 is used to detect the cache ratio of the incremental files in the incremental file list.
[0108] The heating module 603 is used to perform a heating action to heat the incremental files in the incremental file list when the cache ratio meets the preset condition.
[0109] Optionally, a method for determining whether a preset condition is met includes: if the cache ratio is less than a preset threshold, it is considered that the preset condition is met.
[0110] Optionally, the detection module 602 is further configured to periodically detect the cache ratio of the incremental files in the incremental file list at preset intervals.
[0111] Optionally, the detection module 602 detects the cache ratio of the incremental files in the incremental file list, including: randomly sampling a first preset ratio of file paths in the incremental file list to obtain multiple candidate incremental files; detecting the cache ratio of the multiple candidate incremental files, and using the cache ratio as the cache ratio of the incremental files in the incremental file list.
[0112] Optionally, the detection module 602 detects the cache ratio of multiple candidate incremental files, including: for each candidate incremental file, randomly selecting a second preset ratio of data points; detecting the ratio of all data points cached in the memory to obtain the cache ratio of multiple candidate incremental files.
[0113] Optionally, the heating module 603 performs a heating action to heat and cache the incremental files in the incremental file list, including: traversing the incremental file list, obtaining each incremental file, and confirming whether each incremental file is cached in the memory; for the cached incremental files, accessing or operating the incremental files; for the uncached incremental files, reading the external memory storage medium and reloading the incremental files into the cache.
[0114] The above-mentioned heating cache device performs a heating action on the incremental files in the incremental file list when the cache ratio of the incremental files in the incremental file list is lower than a preset threshold value, so as to extend the cache validity of the cached incremental files, and at the same time read the uncached incremental files from the external storage medium into the internal memory. The present application maintains the incremental files at a higher cache ratio, so that a large amount of external storage media does not need to be read during data processing, thereby improving the backup rate.
[0115] Each module in the above heating cache device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.
[0116] The heating cache device provided in this embodiment can execute the method provided in the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be described in detail here.
[0117] Figure 7 The schematic diagram of the computer structure provided in this application. Figure 7As shown, the computer device 70 provided in this embodiment includes: at least one processor 701 and a memory 702. Optionally, the device 70 also includes a communication component 703. The processor 701, the memory 702 and the communication component 703 are connected via a bus.
[0118] In a specific implementation process, at least one processor 701 executes the computer-executable instructions stored in the memory 702, so that at least one processor 701 executes the above method.
[0119] The specific implementation process of the processor 701 can be found in the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be repeated here.
[0120] In the above embodiments, it should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the invention may be directly implemented as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.
[0121] The memory may include a high-speed memory (Random Access Memory, RAM), and may also include a non-volatile memory (Non-volatile Memory, NVM), such as at least one disk memory.
[0122] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.
[0123] The present application also provides a computer program product, including a computer program, which implements the above method when executed by a processor.
[0124] The present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the above method is implemented.
[0125] The above-mentioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general or special-purpose computer.
[0126] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (Application Specific Integrated Circuits, referred to as: ASIC). Of course, the processor and the readable storage medium can also exist in the device as discrete components.
[0127] The division of units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.
[0128] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0129] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0130] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.
[0131] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.
[0132] Finally, it should be noted that those skilled in the art will readily conceive of other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention, which follow the general principles of the present invention and include common knowledge or customary technical means in the art not disclosed by the present invention, are not limited to the precise structure described above and shown in the drawings, and may be modified and changed in various ways without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.
Claims
1. A heating cache method, characterized in that: The method comprises: Querying the incremental file list; wherein the incremental file list is generated by the database responding to the incremental backup start instruction and synchronously recording the paths of the changed files; Detecting the cache ratio of the incremental files in the incremental file list; When the cache ratio meets a preset condition, a heating action is performed to heat the cache of the incremental files in the incremental file list.
2. The method according to claim 1, characterized in that The method further comprises: At preset intervals, the cache ratio of the incremental files in the incremental file list is periodically detected.
3. The method according to claim 1 or 2, characterized in that: The detecting the cache ratio of the incremental files in the incremental file list includes: Randomly sampling a first preset proportion of file paths in the incremental file list to obtain a plurality of candidate incremental files; Detect cache ratios of multiple candidate incremental files, and use the cache ratios as cache ratios of incremental files in the incremental file list.
4. The method according to claim 3, characterized in that The detecting the cache ratios of the plurality of candidate incremental files comprises: For each of the candidate incremental files, randomly selecting a second preset proportion of data points; The proportion of data points cached in the memory among all data points is detected to obtain the cache proportions of multiple candidate incremental files.
5. The method according to claim 1, characterized in that The performing of the heating action to heat and cache the incremental files in the incremental file list includes: Traverse the incremental file list, obtain each incremental file, and confirm whether each incremental file is cached in the memory; For the cached incremental file, access or operate the incremental file; For the incremental files that are not cached, read the external storage medium and reload the incremental files into the cache.
6. The method according to claim 1, characterized in that The judgment method of satisfying the preset conditions includes: If the cache ratio is less than a preset threshold, it is considered that the preset condition is met.
7. A heating cache device, characterized in that: include: A list generation module, used to respond to the database to start the incremental backup instruction, synchronously record the path of the changed file, and generate an incremental file list; A detection module, used to detect the cache ratio of the incremental files in the incremental file list; A heating module is used to perform a heating action to heat and cache the incremental files in the incremental file list when the cache ratio meets a preset condition.
8. A computer device, characterized in that: include: Memory, processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 6 when executed by a processor.
10. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 6 when being executed by a processor.