114 results about "Hit ratio" patented technology

The invention relates to the technical field of data storage and processing, in particular to an RAID card static cache management method and device based on data popularity, and the method comprises the steps that the physical position of a data block needing to be accessed in an SSD array is acquired according to a read-write request; historical data access information of the RAID card is collected, a historical data set is generated, and a neural network model is trained by using the historical data set to obtain a cache management model; predicting and outputting data blocks which are possibly accessed in the future and the access probability of the data blocks through the cache management model; the RAID controller dynamically adjusts a cache strategy in combination with an LRU strategy according to a prediction result output by the cache management model and a read-write request of a file system, and optimizes a storage position and an updating mechanism of a data block in a cache space; and when the hit rate or the data access efficiency does not reach the preset value, adjusting the parameters of the cache strategy and updating the cache strategy. According to the method, cache resources can be more effectively distributed, the cache hit rate is improved, the cache replacement overhead is reduced, and therefore the performance of a storage system is optimized.

The invention relates to the technical field of power management, in particular to an intelligent computing resource energy-saving scheduling system based on load prediction, which comprises a cache access monitoring module, a burst load judgment module, a frequency fluctuation analysis module, a load classification and identification module and an intelligent regulation and control strategy module. According to the method, the access frequency fluctuation is analyzed by monitoring the cache access data, the access mode change is identified, the load judgment precision is improved, the burst load identification is enhanced in combination with the hit rate reduction range, the resource scheduling is more accurate, the CPU / GPU operation frequency and the fluctuation rate are monitored, the abnormal fluctuation is identified, the calculation resource allocation is optimized, and the energy consumption waste of frequency adjustment is reduced; load classification, resource matching degree optimization, dynamic adjustment of CPU / GPU computing power and memory allocation, coordination of computing and data transmission, optimization of energy consumption management, guarantee of task stability and reduction of idle and unbalanced resource problems are carried out based on a time proportion and task characteristics.

The invention relates to the technical field of data cache management, in particular to a multilayer data cache dynamic management method and system, and the method comprises the following steps: based on a data access path, extracting a data access path hierarchy identifier, analyzing path hierarchy depth, recording access continuity, classifying the path to be stable or unstable, and obtaining path hierarchy distribution information. In the invention, through hierarchical analysis and stability classification of the data access paths, the cache resource allocation efficiency, the stable paths and the unstable paths are improved, the access delay is reduced, the access continuity is improved, the cache waste caused by hopping is reduced, the space utilization rate is improved, the cache pollution is avoided, the storage sequence is optimized, and the hit rate is improved; through dynamic elimination, resource competition is reduced, storage medium I / O load is monitored, medium load is balanced, throughput capacity is improved, data flow is optimized, cache coordination capacity is improved, cache levels can flexibly adapt to access mode changes, and data storage stability and load balance are enhanced.

The invention discloses a cache space control method of a storage system, electronic equipment and a storage medium, and relates to the technical field of data caching, and the method comprises the steps of identifying dirty data, comparing the size relation between the hit rate of cached data in a cache space and a first hit rate threshold value and a second hit rate threshold value, and when the hit rate is greater than the first hit rate threshold value, controlling the cache space of the storage system. When the hit rate is smaller than a first hit rate threshold value, executing an expansion instruction to control the cache module to expand a cache space, and when the hit rate is smaller than a second hit rate threshold value, controlling the cache module to brush dirty data down to a rear-end memory, executing a reduction instruction to control the cache module to reduce the cache space, and performing a cache hit rate judgment mechanism and a linkage telescopic cache mechanism in a full random access scene. The problems of performance reduction, high delay of data access, high power consumption and the like of the cache system due to the fact that the cache space is fixed and cannot adapt to different application scenes and changes of data loads in the prior art are solved, performance self-adaption of the IO model is achieved, the response speed is increased, and the performance of the cache system in multiple storage scenes is improved.

The invention belongs to the field of integrated circuits and computer system structures, and provides a caching method and system for a memory access unit of a superscalar processor, and the method comprises the steps: receiving a plurality of memory access instructions in the same period, and determining a corresponding Bank in a to-be-accessed cache through the memory access instructions; after the memory access instruction obtains a cache access permission, if cache line missing occurs, generating a missing request, merging all the missing requests, and performing parallel prefetching training on the merged missing requests by utilizing a mode of fusing a constant step length prefetching mode and a complex step length prefetching mode to obtain a prefetching request and a prefetching cache address corresponding to the prefetching request; requesting a missing cache line from the first-level cache to the second-level cache based on the missing queue, and writing the missing cache line back to the cache line of the corresponding data cache in the first-level cache; and storing the bus consistency request by using the sniffing queue, judging whether the data in the multi-core cache are consistent or not by using the consistency request, and performing consistency modification according to a judgment result. The cache hit rate and the bandwidth utilization rate are improved.

The invention provides a large model reasoning method and system based on a multi-level cache mechanism, electronic equipment and a storage medium, and relates to the technical field of computers. The large model reasoning method based on the multi-level cache mechanism comprises the following steps: receiving an original request; based on the key value cache distribution and the load condition of each instance, determining a pre-filling instance and a decoding instance corresponding to the original request; determining a plurality of key value cache blocks of the original request based on a three-level cache mechanism through a pre-filling instance; based on the key value cache block, executing calculation in a pre-filling stage to obtain a first output mark in the pre-filling stage; performing calculation in a decoding stage based on the first output mark in the pre-filling stage and the key value cache block through the decoding instance to obtain a complete output mark corresponding to the original request; and determining a reasoning result of the original request based on the complete output mark. Therefore, the hit rate of the prefix cache can be greatly improved, and the problem of load imbalance is effectively relieved.

The invention relates to the technical field of data cache management, and discloses a segmented multi-level data cache management method and device, computer equipment and a storage medium. The method comprises the following steps: defining a hierarchical data management module, wherein the data management module comprises a first-level data interaction sub-module and a second-level cache hit management sub-module; receiving an upper-layer data access request, and performing data splitting according to the logic address relationship; querying the module state of the position according to the actual situation, and marking the cache hit management module state of the corresponding position; if the second-level cache hit management sub-modules to which the first-level data interaction sub-modules belong are all hit, realizing data communication with lower-layer storage equipment according to large granularity; and if part of data enters the cache, according to the continuity of the data hit state, respectively constructing commands with corresponding lengths to lower-layer storage equipment. By implementing the method provided by the invention, access requirements of different types of data can be effectively realized, the cache hit rate is improved, and better performance improvement is obtained.

The embodiment of the invention discloses a self-adaptive frequency modulation method and device which are used for improving the frequency modulation accuracy of a processor. The method comprises the steps that the computing device collects real-time monitoring data of the processor, the real-time monitoring data comprises one or more events monitored by a performance monitoring unit (PMU) of the processor, and the events comprise one or more of the following items: the number of instruction execution times, the cache hit rate and the branch prediction error rate. A predicted performance change rate of the processor is calculated based on the real-time monitoring data, the predicted performance change rate is determined based on a current performance change rate of the processor, the current performance change rate is determined based on the real-time monitoring data, and the predicted performance change rate is used for indicating the proportion of a reference performance value to an operation performance value of the processor. And determining a target frequency of the processor based on the target performance loss rate and the predicted performance change rate, wherein the target performance loss rate is used for indicating the predicted performance change rate tolerable by the processor.

The invention provides a cache elimination method and device, equipment, a medium and a program product, relates to the technical field of data processing, and aims to solve the problem of low cache hit rate. The method comprises the following steps: monitoring a key operation event of a Redis node based on an EBPF program to obtain a first key name of a first key value pair operated by the key operation event and access information corresponding to the key operation event; inputting a first service label corresponding to the first key name and the access information into a preset machine learning model for judgment to obtain a target cache elimination strategy of the first key value pair; updating a preset strategy mapping table based on the first service label and the target cache elimination strategy to obtain a first updated strategy mapping table; and performing cache elimination on the key value pair of the Redis node based on the first updating strategy mapping table. The cache hit rate can be improved.

The invention relates to the technical field of computers, and discloses a cache replacement method, system and device based on binary tree status bit management and a medium. The method comprises the following steps: firstly mapping N cache lines of a cache unit into N leaf nodes of a binary tree, then setting status bits of internal nodes and leaf nodes of the binary tree, preferentially replacing the empty cache lines when accessing the cache, then judging whether the cache is hit or not, and if the cache is hit, judging whether the cache is hit or not. Determining state transition of the internal node according to whether the path node corresponding to the hit cache line is the same as the internal node, and updating the state of the leaf node; when the cache is not hit, the historical queue is checked firstly, then the sub-tree is selected according to the node state value to search and replace the cache line, and whether replacement is carried out or not is determined according to the leaf node and the state bit of the new cache. According to the method, relatively low hardware overhead can be kept, frequency locality and time locality can be better balanced, a higher cache hit rate is provided, and relatively good performance is achieved when data of different access modes are processed.

The invention discloses a filter type cache replacement method based on reinforcement learning and a related device, and the method employs a dynamic learning rate technology, pays attention to the cache miss condition during the operation of the method at any time, quantifies the miss condition into a loss value, and adjusts the learning rate in the direction of reducing the loss value through a gradient descent method. And the cache replacement method is always in better performance. A cache replacement problem is abstracted into a dobby machine problem, and cache replacement is guided by using an LRU algorithm and an LFU algorithm with weight values. The weight of the expert algorithm is adjusted according to the cache miss condition so as to adaptively change the workload. For a cache structure, the cache structure is logically divided into three layers, the first two layers of the cache quickly filter non-frequent access data, and the third layer of the cache retains data which are frequently accessed in the future as much as possible, so that the hit rate of a cache replacement algorithm is increased. In addition, the method can dynamically adjust the cache structure, and the adaptive capacity of the method is further enhanced.

The invention provides a distributed large model reasoning method and system based on modular cache, and the method comprises the steps: disassembling a prompt into modules which can be independently reused through modular division driven by Schema, and calculating the attention Key-Value state of each module in advance before reasoning for caching. When a user request arrives, the system firstly performs module analysis and cache assembly on a prompt, loads a cache as required and supplements a missed part, and then injects a complete KV state into a reasoning process. Meanwhile, a layered and distributed scheduling mechanism is designed, a global scheduler selects a target GPU based on a cache hit rate and a node load, and a local scheduler manages cache copying and elimination in a node, so that load balancing and cache multiplexing are both considered. According to the scheme, repeated calculation can be remarkably reduced, the first Token delay is reduced, the system throughput rate is increased, and the method is suitable for high-repetition prompt scenes such as code generation and long text question and answer.

The invention discloses a data block cache updating method and device, equipment and a storage medium, and relates to the technical field of processor cores, and the method comprises the steps: obtaining a data access request for a target chip, and entering a target cache line based on an access address in the data access request to carry out data matching, so as to judge whether the data access request is in a memory access hit or not; if the data access request does not have access hit, judging a data cache running state based on the number of hit identifiers in the target access identifier signal; if the running state of the data cache is a normal running state, determining a first target cache data block based on the lowest hit identifier in the target memory access identifier signal, and if the distance between the hit identifiers in the first target cache data block is smaller than a preset distance threshold value, determining a second target cache data block; and if yes, performing data replacement on the first target cache data block to complete cache data block updating, and performing cache identifier refreshing on each group of cache identifiers of the target chip. In this way, the cache hit rate of the data blocks can be increased.

Embodiments of the present application disclose an adaptive frequency modulation method and apparatus, which are used for improving the frequency modulation accuracy of a processor. The method in the embodiments of the present application comprises: a computing device acquiring real-time monitoring data of a processor, the real-time monitoring data comprising one or more events monitored by a performance monitoring unit (PMU) of the processor, and the events comprising one or more of the following: the number of times of instruction execution, a cache hit rate, and a branch prediction error rate; on the basis of the real-time monitoring data, computing a predicted performance change rate of the processor, the predicted change rate being determined on the basis of a current performance change rate of the processor, the current performance change rate being determined on the basis of the real-time monitoring data, and the predicted performance change rate being used for indicating the ratio of a reference performance value of the processor relative to an operating performance value; and, on the basis of a target performance loss rate and the predicted performance change rate, determining a target frequency of the processor, the target performance loss rate being used for indicating a predicted performance change rate tolerable by the processor.

The invention relates to a cache data processing method and device, computer equipment, a storage medium and a computer program product. The method comprises the steps of obtaining task related data of a current running task, and inputting the task related data into a pre-trained prediction model; the prediction model is a machine learning model which is obtained based on self-attention mechanism training and is used for determining correlation among the operation tasks; a to-be-cached data list for the next task is output through the prediction model, the to-be-cached data list comprises respective caching probabilities of a plurality of data units, and each data unit comprises a data table and a data path; and determining target cache data according to the to-be-cached data list, and storing the target cache data in a preset cache. By adopting the method, the hit rate of the cache can be improved.

The invention relates to a distributed storage cache hotspot prediction method and system based on an access mode. The method comprises the following steps: acquiring an access log to obtain original data; the gradient change of the access frequency between the adjacent data blocks is analyzed in real time to divide the hot spot range and identify continuous hot spot data blocks; constructing a time sequence based on the historical access record, and pre-judging an access hotspot in a future time period by applying a time sequence trend prediction algorithm; constructing a multi-dimensional feature vector and inputting the multi-dimensional feature vector into a machine learning prediction model to output a hotspot probability of the corresponding data object in a future time period; according to the hotspot probability and a popularity threshold value, scheduling the data predicted as the hotspot into a cache, and allocating corresponding cache levels or storage paths for the data objects with different popularity at the same time; and periodically updating the prediction model and the popularity statistics to obtain dynamic prediction and cache optimization of the hotspot data. According to the invention, the prediction of the hotspot data is realized, and the hit rate and the system performance of the distributed cache are improved.

The present application belongs to the technical field of cloud computing and provides a computing system, a multi-round session inference method, an apparatus and a computing device cluster. In the system, an external storage device stores a historical key value cache of a completed session. As the capacity of the external storage device is far greater than the capacity of an HBM in an accelerator, the hit rate of the historical key value cache can be increased, thereby avoiding recomputing the key value cache. In addition, when the accelerator processes a session, a host can preload a historical key value cache of a session to be processed in a task queue from the external storage device to an internal memory of the host; when performing i-th layer computing on the session, the accelerator can preload from the internal memory of the host the historical key value cache required for the (i+1)-th layer computing. As the computing process and the data loading process are synchronously performed, the computing process does not need to wait for the completion of data loading, such that the time overheads of the accelerator accessing the external storage device can be hidden, improving the efficiency of multi-round session inference.

The embodiment of the invention provides a multi-level cache access method, system and device and a storage medium, and relates to the technical field of data cache access, and the method comprises the following steps: obtaining a key field in a user auditing request, and converting the key field into a feature vector; searching whether a reasoning result corresponding to the feature vector exists in a first preset cache or not; if yes, a reasoning result is returned to the user; if not, a corresponding semantic partition is found in a second preset cache, and a historical cache vector with the highest similarity and a corresponding reasoning result are determined from the semantic partition; and determining a reasoning result corresponding to the feature vector according to the feature vector, a historical cache vector and a reasoning result corresponding to the historical cache vector. In this way, a two-stage cache mechanism based on the feature vector is constructed, a corresponding reasoning result is found in combination with semantic partition, the cache hit rate is increased, repeated reasoning of a large model is reduced, response delay is reduced, and therefore the requirements for high redundancy and high real-time performance of cache data reasoning are met.

The invention relates to the technical field of computers, in particular to an aging processing method and device in a cache and electronic equipment, and the method comprises the following steps: receiving a data query request; if it is determined that the target data requested by the data query request is located in the cache, obtaining the target data from a target cache table item in the cache, and returning the target data to a sender of the data query request; meanwhile, if the target cache table item is not aged, reducing the residual maximum hit times of the target cache table item, and updating the residual survival time length to the target survival time length; if the residual maximum hit frequency of the target cache table item is smaller than a first threshold value, or the residual survival duration is smaller than a second threshold value, determining that the target cache table item is aged; according to the method provided by the invention, the aging of the cache table item is restricted by the residual maximum hit times and the residual survival duration, so that the hit rate of the cache is improved.

The invention discloses an importance perception KV cache management system and method, and aims to solve the problems of long reasoning time and low throughput rate caused by low efficiency of a traditional K and V cache management strategy in a large model reasoning process. According to the method, the importance is introduced into the management strategy of the K and V caches, the cache hit rate on a relatively fast medium in storage is improved by tracking the importance of the K and V, combining the read frequency of the K and V and using the importance score as the basis of cache management, the time for reading the K and V is shortened, the overall time delay of an inference system is reduced, and the throughput is improved. The method is suitable for importance-based large model reasoning tasks with shared prefixes, the model reasoning precision can be maintained, meanwhile, the output time delay is shortened, and the throughput capacity is improved by about two times.

The invention relates to the technical field of storage control, in particular to a memory control method, a storage device, a medium and computer equipment, a three-level index structure is arranged, only a first-level root table resides in a cache, an index is rapidly extracted through bit operation so as to reduce cache occupation and invalid IO overhead, the search range is narrowed through a hash bucket of a three-level page table, and the search efficiency is improved. Conflicts are solved through a linked list, and the mapping efficiency and the system stability can be improved through a fixed structure; and the second-level block table and the third-level page table are loaded in a non-blocking manner without occupying a CPU, so that the bandwidth is saved, and the concurrency performance and the cache hit rate are improved. Through the overall scheme of three-level index, chained hash table, loading on demand and bit operation, the delay of the whole process from logic address input to physical address output is remarkably reduced, and the low delay requirement of a high-performance storage system is met; the three-level index structure supports flexible adjustment of the sizes of a root table, a block table and a page table, adapts to storage devices with different capacities, and has good expandability.

The invention relates to the technical field of cache management, in particular to a cache management method, device and system. According to the method, cache data are screened by introducing pheromone concentration, hot data (namely hot data) and cold data (namely non-hot data) are distinguished in combination with a pheromone threshold T, pheromone updating is performed aiming at data access frequency, and the pheromone concentration difference between the hot data and the non-hot data is increased, so that data items accessed at high frequency are cached preferentially, and the data access efficiency is improved. The hit rate is improved, the use of limited cache space is optimized, and the cache performance and the resource utilization rate are improved. According to the method, the pheromone concept is introduced to dynamically evaluate and manage the cached data, so that a more efficient and more flexible caching strategy is realized, and the defects of poor dynamic adaptive capacity and the like of a caching system in the prior art are overcome.

The invention discloses a high-concurrency time series data processing method and device for an anti-unmanned aerial vehicle system. According to the method, a lock-free hash table is adopted in a cache space to cache time sequence data, lock overhead is reduced through lock-free cache design and CAS atomic operation, the batch writing throughput is high, the conflict probability is low, multi-thread high-concurrency reading and writing are supported, thread competition and blocking caused by a traditional cache mechanism are thoroughly eliminated, and the concurrent processing capacity is improved; meanwhile, the expenditure of dynamic memory allocation is reduced through batch writing, and the memory utilization rate is increased; through quick positioning of a compound key, priority query of a hotspot data index structure and a lock-free reading mechanism, the query delay of hotspot data is extremely low, the delay of related query in the future is further reduced through a data preloading mechanism, and the real-time response capability is improved; based on a dynamic elimination mechanism of an elimination score, hotspot / recent data can be reserved preferentially, the resource utilization rate is ensured, the cache hit rate is remarkably improved, and the access frequency of the TSDB is greatly reduced.

Apparatus and method for throttling ray tracing operations based on a cache hit rate. For example, one embodiment of a processor comprises: a cache subsystem comprising one or more caches; circuitry to track a plurality of hits and misses in the cache subsystem for data accesses associated with ray tracing operations; and thread management logic to dynamically control a working set size for the ray tracing operations based on the plurality of hits and misses.

This invention discloses a cache adjustment method, apparatus, device, and computer-readable storage medium, comprising: collecting access characteristic data from the client layer, object storage daemon layer, and device layer respectively; determining the object access mode of the system based on the access characteristic data; and adjusting the cache priority of each access task, the cache capacity ratio between the client layer and the object storage daemon layer, and the data residence time in the cache layer according to the object access mode; wherein the cache layer includes the client layer and the object storage daemon layer. This invention improves cache hit rate and overall read / write throughput performance, and reduces access latency.

A dynamic data loading method, a graphics processor, and a readable storage medium are disclosed. The dynamic data loading method includes: responding to a received data request, detecting the current operating mode of the caching module; the current operating mode is either a first mode or a second mode, where in the first mode the data request reads data in units of cache lines, and in the second mode the data request reads data in units of sub-blocks within a cache line; performing cache line miss detection based on the data request; in the current operating mode, determining whether to perform a cache line swapping operation based on the miss detection result; responding to the determination that a cache line swapping is triggered, performing the cache line swapping operation, and determining whether there is a need to switch operating modes; and determining whether to switch the current operating mode based on the number of times the cache line swapping operation is performed in the current operating mode and the number of times there is a need to switch operating modes. This solution can improve the performance and hit rate of the caching module.

The application discloses a kind of high concurrency time series data processing method and device for anti-UAV system.The application uses lock-free hash table to cache time series data in cache space, lock-free cache design and CAS atomic operation reduce lock overhead, batch write throughput is high, conflict probability is low, support multi-thread high concurrency read-write, completely eliminate thread competition and blocking caused by traditional cache mechanism, improve concurrent processing capability;At the same time, batch write reduces the overhead of dynamic memory allocation, improves memory utilization;Through composite key fast positioning, hot data index structure priority query and lock-free reading mechanism, the query delay of hot data is extremely low, data preloading mechanism further reduces the delay of future related query, improves real-time response capability;Based on the dynamic elimination mechanism of elimination score, hot data / recent data can be preferentially retained, ensure resource utilization, significantly improve cache hit rate, greatly reduce access frequency to TSDB.

The invention discloses a cache implementation method and device, and the method comprises the steps: setting a plurality of replacement algorithms for a cache, one of the replacement algorithms being a main replacement algorithm, and the rest being auxiliary replacement algorithms; and circularly executing the steps according to a preset frequency: counting an accumulated value of a cache miss number of each replacement algorithm; determining the cache hit rate of each replacement algorithm according to the accumulated value of the cache miss number; when the replacement algorithm corresponding to the highest cache hit rate is an auxiliary replacement algorithm, setting the auxiliary replacement algorithm corresponding to the highest cache hit rate as a new main replacement algorithm; wherein when the cache receives the access request, the cache miss number of each replacement algorithm is updated. The cache hit rate can be improved.

The invention belongs to the field of GPGPU chip design, and particularly relates to a GPGPU thread block scheduling method and system based on data space locality, and the method comprises the steps: carrying out the statistics of Bank feature information of access data of all thread blocks, and classifying the thread blocks accessing the same Bank into the same Bank group according to the Bank feature information; preferentially distributing the thread blocks of the same Bank group to the same programmable multiprocessor until the resources of the programmable multiprocessor are saturated; setting a private row cache space for each Bank in each programmable multiprocessor; when the data in the private line cache space is updated, synchronously updating the corresponding data in the L1 cache, the L2 cache and the DRAM; counting the hit rate of the private line cache in real time, and closing the private line cache function when the hit rate is lower than a preset threshold value. High-delay external storage access is reduced, the data reuse rate is improved, and the execution efficiency is remarkably improved.

The invention provides a method and a device for adaptively scattering cache expiration duration. The method comprises the following steps: acquiring a current system load rate and a cache hit rate from a distributed system; the system load rate and the cache hit rate are processed through a preset scattering model, the scattering range of the cache expiration duration is determined, and the scattering range is a dynamic time interval; when it is detected that the cache data is written into the cache, the basic expiration duration of the cache data is determined; and increasing the scattering range on the basis of the basic expiration duration to obtain the final expiration duration of the cached data. The stability of the system can be improved.