47 results about "Cache locality" patented technology

The invention relates to the technical field of computer data storage and distributed systems, in particular to a distributed read-write method for large model training, which comprises the following steps of: constructing a hierarchical structure of local cache, distributed shared cache and persistent storage, and maintaining a global cache table copy at each client to register file blocks and cache positions. And during writing, firstly writing in a local cache and copying to other client nodes, and submitting persistent storage after registration is completed. During reading, the file blocks are obtained from the local cache and the distributed shared cache in sequence, if the file blocks are not hit, the file blocks are obtained from the persistent storage, meanwhile, the effective file blocks are written back to the local, and table items are supplemented. Unified visibility is achieved through position mapping and version constraint, nearby reading and fault recovery are achieved, back-end pressure and access delay are reduced, and the method is suitable for large-scale training and batch processing scenes.

The invention provides a data processing method and device of a processor, equipment, a medium and a program product. The method comprises the steps of loading an mth data block in a first matrix to a first cache position of an internal memory through a first thread in a thread group of a processor, and loading an nth data block in a second matrix to a second cache position of the internal memory; loading the (n + 1) th data block in the second matrix from the external memory to a third cache position of the internal memory through the first thread, and performing multiplication operation on the data blocks in the first cache position and the data blocks in the second cache position through the second thread; and loading the (n + 1) th data block in the second matrix from the internal memory to a second cache position of the internal memory through the first thread, and performing multiplication operation on the data block in the first cache position and the data block in the third cache position through the second thread. According to the invention, the calculation speed of multiplication in the processor can be improved.

The embodiment of the invention relates to a text processing method and device, computer equipment and a storage medium, and the method comprises the steps: carrying out the fragmentation processing of a semantic unit contained in an input text, and obtaining a plurality of semantic fragments; calculating an importance score for each semantic fragment; according to the attribute information and the importance score of each semantic fragment, determining a cache position corresponding to the semantic fragment; and storing each semantic fragment to a corresponding cache position. Therefore, the text can be fragmented through the semantic unit, semantic segmentation is avoided, semantic continuity is guaranteed, meanwhile, each semantic fragment is stored to the corresponding cache position according to the attribute and importance, and the utilization efficiency of calculation and storage resources is improved.

The invention discloses a data caching method and device, equipment and a medium. The method comprises the following steps: acquiring metadata of to-be-cached data; the metadata comprises an index key, a data value and a data recent calling frequency; according to the recent data calling times of the to-be-cached data, calculating a heat value of the to-be-cached data; comparing the popularity value with a popularity threshold value, and determining a popularity comparison result; determining a data type of the to-be-cached data according to a popularity comparison result; according to the data type, determining a cache position corresponding to the to-be-cached data; and caching the to-be-cached data to the corresponding caching position according to the caching position of the to-be-cached data and the metadata. According to the embodiment of the invention, the data caching efficiency can be improved.

The invention discloses a PCIe-based multi-channel DMA task management system and method, and relates to the technical field of data transmission, and the method comprises the steps: employing a DMA task reading control module and a mark number management module to apply for a unique mark number for each reading request, so as to distinguish the DMA task of each channel, and a DMA task storage control module and a cache management module are utilized to manage cache position numbers corresponding to the mark numbers, the DMA tasks of the channels are read according to the mark numbers, and the DMA tasks are written into corresponding cache positions, so that the DMA tasks of the channels are prevented from being executed out of order. The technical problems that the DMA task reading efficiency is low and extra cache resources are occupied when the DMA tasks of the multiple channels are executed in an order-preserving mode are solved, and the technical effects that the DMA task reading efficiency is improved, and meanwhile the cache resources are saved are achieved.

The invention provides a communication method, communication node equipment, a computer readable medium and a product, and relates to the technical field of communication, and the communication method comprises the steps: receiving a first information transmission frame sent by a first opposite-end communication node; in response to retransmission indication information generated according to a sending sequence number of the first information transmission frame, sending a first retransmission indication frame to the first opposite-end communication node, the first retransmission indication frame comprising the retransmission indication information and a first receiving sequence number, the first receiving serial number is the receiving serial number of the information transmission frame sent by the first opposite-end communication node confirmed to be correctly received at the last time by the local-end communication node; the first retransmission indication frame is used for the first opposite-end communication node to start reading the cached information transmission frame from a cache position corresponding to a first receiving serial number in a pre-configured retransmission cache region corresponding to the local-end communication node in response to the retransmission indication information, and retransmission operation is carried out.

The application provides a resource refreshing method and system. When it is needed to refresh a resource file, the application does not need to perform a refreshing operation on an edge device, but deletes a cache location record corresponding to the resource file in a database associated with a scheduling server, and then sets a first domain name for a resource file that does not need to be updated and checked when a resource access request sent from a client is received, so as to directly return the resource file in a case where the target edge device locally caches the resource file, and sets a second domain name for a resource file that needs to be refreshed, so as to perform an update check on the resource file in a case where the edge device locally caches the resource file, and obtain the latest resource file. Through the above scheme, unified refreshing operations on the edge device are not needed, and the latest resource file can also be ensured to be obtained by the client, and the performance occupation of the edge device is reduced.

The invention relates to the field of data lookup, and discloses a locality perception lookup table lookup method, which comprises the following steps of: S1, reordering between rows: clustering and reordering the rows of an input vector and a weight matrix according to the same quantized value to enable elements with the same quantized value to be continuously distributed; for a common matrix GeMV scene, cache locality is improved through rearrangement and subsequent blocking operation, and repeated loading of a lookup table LUT is reduced. And the data locality of the GeMV scene is remarkably improved through inter-line reordering and a virtual mapping strategy. On the basis of reordering of input vector element values, elements with the same value are aggregated, so that the LUT line loading times are reduced to 256 times at most from being in direct proportion to the input dimension d, and frequent replacement of the LUT lines in the WRAM is avoided; meanwhile, a weight matrix is divided into BR * BC sub-matrixes, the characteristic that vertical adjacent rows share an accumulator is utilized, multi-row sub-matrix calculation is loaded at a time, and virtual rearrangement maintains the row matching relation between an input vector and the weight matrix through index mapping.

The invention discloses an unpacking method and device, electronic equipment and a storage medium, and the unpacking method comprises the following steps: receiving plate demand information sent by an MES system, and determining target plates and a target number corresponding to the target plates based on the plate demand information; when the sum of the unpacked number and the non-unpacked number is larger than or equal to the target number, the following unpacking operation is executed, specifically, the target position of the non-unpacked target board in the warehouse is obtained, the stacker is used for conveying the non-unpacked target board to the RGV, and the RGV conveys the non-unpacked target board to the cache position; the non-unpacked target boards at the temporary storage position are conveyed to an unpacking station; and the non-unpacked target plates are grabbed to the plate storing and taking position one by one through the mechanical arm till all the non-unpacked target plates are grabbed to the plate storing and taking position. Manual intervention of unpacking operation is reduced, the automation level and efficiency of a production line are improved, and the efficient production requirement of intelligent manufacturing is met.

The present application provides a point cloud data processing method, an apparatus, and a point cloud data processing circuit. The point cloud data processing method includes: when processing current point data by an i-th level algorithm, reading current sliding window data centered on the current point data, the current sliding window data including at least two cached data, each cached data being stored in a corresponding cache location, each cached data comprising point data and tag information identifying row number information of the point data, where i is an integer greater than 1; determining target point data based on the tag information, and determining corresponding cached data based on the target point data; and updating the current sliding window data based on the cached data that has been determined, and performing the i-th level algorithm processing on the current sliding window data.

The invention provides a content resource cache position updating method and device, equipment, a medium and a product, and belongs to the technical field of artificial intelligence, and the method comprises the steps: determining accessed path information of a target content resource in a preset time period in response to an acquisition request of the target content resource initiated by a terminal user; inputting the visited path information into a pre-trained anomaly detector, and judging whether the visited path information is abnormal or not by the anomaly detector and outputting a detection result; if the detection result is abnormal, obtaining a structure topological graph of cache nodes used for caching the content resources, and determining a feature matrix and an adjacent matrix of the structure topological graph; and obtaining a cache position updating result of the target content resource according to the feature matrix, the adjacent matrix and the accessed path information. Compared with a mode of maintaining manual configuration of an administrator, the cache position updating speed is higher, errors are not prone to occurring, and the requirement of a terminal user for application experience and increasing internet application flow can be met.

A data processing service receives a request from a user to execute code in a notebook. The service initiates a first VM for execution of the code in the notebook based on the request. The first VM may be set up with a virtual environment with configurations for executing the code. The service automatically caches the virtual environment with the configurations in a data store and automatically caches metadata associated with the virtual environment in a metadata store. The metadata may include a location identifier for identifying a caching location of the virtual environment in the data store. The metadata may include an expiration condition. When the virtual environment meets the expiration condition, the virtual environment will be invalidated in the data store. The service executes the code in the notebook in the virtual environment.

This application provides an IP address network partitioning method, apparatus, device, and storage medium, belonging to the field of asset management technology. The method includes: converting a target IP address into an integrated IP address block, wherein the target IP address belongs to either IPv4 or IPv6; determining the host bit width based on a variable-length subnet mask, and logically right-shifting the tail address block within the IP address block according to the host bit width to obtain a bit value; comparing the bit value of the tail address block with a reference bit value of the tail address block in a preset network partitioning rule to determine whether the target IP address matches the network partitioning rule. This method eliminates code redundancy and branch prediction failures. It significantly improves cache locality and instruction pipeline efficiency, thereby enhancing the adaptability of the solution.

Embodiments of the present application provide a robot order-picking method, system, server and storage medium, and relate to the technical field of intelligent warehousing. The method comprises: obtaining an order-picking task of moving a target bin in a warehouse from a first storage position in a first rack to a second storage position in a second rack; determining a first cache position of the target bin according to the first storage position, and controlling a first robot to move the target bin from the first storage position to the first cache position; the first cache position belongs to a first cache area in the same column as the first rack; determining a second cache position of the target bin according to the second storage position and the first cache position, and controlling a second robot to move the target bin from the first cache position to the second cache position; the second cache position belongs to a second cache area in the same column as the second rack and in the same layer as the first cache area; and controlling a third robot to move the target bin from the second cache position to the second storage position, thereby improving order-picking efficiency.

The present application relates to the technical field of integrated circuit design, in particular to a kind of 1553B bus protocol chip's interrupt control and data packing method, comprising the following steps: in 1553B bus message transmission, interrupt event information, command word, status word, data word length, error state and cache index are collected, package description item is generated and is bound with corresponding data word, data word range and cache reading position are determined according to package description item, and then write in package queue, according to interrupt event information, error state and package queue state, interrupt arbitration is carried out, after host processor reads package description item and corresponding data word, interrupt confirmation and cache release are executed.The present application associates interrupt reason, message boundary, cache position and data word packing relationship on chip side, so that host processor reads message data according to package, and makes interrupt output, data reading and cache release keep corresponding relationship.

The invention relates to an annotation data processing method and device, equipment, a medium and a product, and the method comprises the steps: obtaining corresponding incremental annotation data in response to an annotation operation of a user on a current page; storing the incremental annotation data to a cache position corresponding to the current page, and rendering the incremental annotation data to the current page; and under the condition that the user ends the annotation operation for the current page, exporting each piece of incremental annotation data in the cache position corresponding to the current page. According to the method, every time the user performs the annotation operation on the current page, the annotation data generated by the annotation operation serves as the increment annotation data to be cached, and after the user ends the annotation operation for the current page, the caching work of the increment annotation data of the current page is completed; therefore, the exporting efficiency of the annotation data is greatly improved.

The invention discloses a cloud native database memory pooling method and device, electronic equipment and a storage medium, and the method comprises the steps: constructing a local buffer pool and a remote buffer pool hash table at each computing node in a database cluster comprising a master computing node and a plurality of slave computing nodes, the remote buffer pool hash table is used for recording the cache positions of the data pages in other computing nodes; responding to a data page access request received by any computing node, taking the computing node as a current node, and querying a local buffer pool; under the condition that the data page is not cached locally, the current node queries a remote buffer pool hash table to determine whether the data page is cached in a target computing node or not; and under the condition that the data page is cached in the target computing node, the current node reads the data page from a local buffer pool of the target computing node through a remote direct memory access network. According to the method and the device, the cluster-level memory utilization rate is improved, delay among the computing nodes is eliminated, and elastic capacity expansion and shrinkage are realized.

The application discloses a kind of heterogeneous data caching methods for multimodal real-time search, it is related to heterogeneous data caching technical field, the application includes: S10: the real-time search feature of key information is constructed;S20: each shard is matched with each modality type;S30: the cache area of each cache object is clear;S40: the search index of each cache object in corresponding cache area is determined;S50: according to the search frequency of key information, the cache location of the search index corresponding to key information, first cache area and second cache area is determined.The application can combine cache information according to matching result, and then quickly obtain the first search result of key information, which is beneficial to the search system to quickly respond when facing different combinations of heterogeneous data, and update the real-time cache result of key information, and match the updated cache result with the modality type, which is beneficial to improve the search efficiency of the search system.

A processing system includes one or more DMA engines that load data from memory or another cache location without storing the data after loading it. As the data propagates past caches located between the memory or other cache location that stores the requested data (“intermediate caches”), the data is selectively copied to the intermediate caches based on a cache replacement policy. Rather than the DMA engine manually storing the data into the intermediate caches, the cache replacement policies of the intermediate caches determine whether the data is copied into each respective cache and a replacement priority of the data. By bypassing storing the data, the DMA engine effectuates prefetching to the intermediate caches without expending unnecessary bandwidth or searching for a memory location to store the data, thus reducing latency and saving energy.

The invention discloses an online car-hailing driver position caching method, which comprises the following steps of: preprocessing a position message reported by a driver, and mapping the preprocessed position message to a space-time key consisting of a geographic unit identifier and a time bucket number; according to a comparison result of the offset of the original timestamp in the corresponding time bucket and a preset threshold value, writing the driver identifier into a cache position identified by one or more continuous space-time keys, and setting uniform survival time for the cache position; in response to a nearby driver query request of the passenger, determining an associated geographic unit set according to a query position, and determining a target time bucket number according to a query moment; and obtaining and returning a nearby driver identifier set by concurrently reading a cache position jointly determined by the geographic unit set and the target time bucket number. A high-performance and extensible solution is provided for systems needing real-time geographic position management, such as online car-hailing and instant distribution.

In one implementation, a computer implemented method for predicting new information based on a previous information may include creating a draft cache and a target cache within a memory of the computer wherein the draft cache and the target cache have a fixed length. The method may include storing tokens representing the information into the caches, the storing may start at a leftmost cache location. The method may also include forming a mask and an index or pointer for each cache. As new entries are formed, they are added to the caches, and the masks and pointers are updated to include to the entries that are added.

The present disclosure relates to a page data acquisition method and apparatus, a communication device, a storage medium, and a program product. The method comprises: receiving a geographic cache pre-request sent by a client, the geographic cache pre-request being used for requesting page cache data of a target page of a target application; in response to the geographic cache pre-request, on the basis of a target query strategy, determining, from geographic cache data, a target cache location matching the location of the client, and target page cache data corresponding to the target cache location, wherein the target query strategy comprises a target query radius, the distance between the target cache location and the location of the client is less than or equal to the target query radius, the geographic cache data comprises a plurality of cache locations and a plurality of pieces of page cache data respectively corresponding to the plurality of cache locations, and the page cache data is real page data of the target page displayed by the client at the corresponding cache locations before the geographic cache pre-request; and returning the target page cache data to the client.

Apparatuses, systems, and techniques to cause information to be invalidated in a second cache location after information is stored in a first cache location. In at least one embodiment, one or more circuits are to perform an application programming interface (API) to cause information to be invalidated in a second cache location after information is stored in a first cache location.

Systems and methods are provided for routing wireless emergency calls to an appropriate public safety answer point (PSAP). When an emergency call is initiated by user equipment (UE), an age of the cached location of the UE is determined. Based on the age of the cached location, a variable delay timer is assigned for communicating a session information protocol (SIP) INV message comprising a location of the UE to a gateway. The location, in various aspects either the cached location or the fresh location, is communicated to the gateway, enabling the UE to communicate with the PSAP.

The invention provides a resource refreshing method and system. When the resource file needs to be refreshed, the cache position record corresponding to the resource file is deleted in the database associated with the scheduling server instead of performing refreshing operation on the edge device, so that when the resource access request sent by the client is received, the cache position record corresponding to the resource file is deleted in the database associated with the scheduling server. A first domain name is set for a resource file which does not need to be updated and verified so as to indicate a target edge device to directly return the resource file under the condition that the resource file is locally cached, and a second domain name is set for a resource file which needs to be refreshed, and sending the resource file to the edge equipment to indicate the edge equipment to update and check the resource file under the condition that the resource file is locally cached, and obtaining the latest resource file. By means of the scheme, it can be ensured that the client obtains the latest resource file without unified refreshing operation on the edge device, and performance occupation of the edge device is reduced.

The invention relates to the technical field of quantitative financial distributed computing, and discloses a distributed parallel Monte Carlo financial risk assessment method and a distributed parallel Monte Carlo financial risk assessment system. Comprising the following steps: analyzing task dependence intensity to identify a task cooperation group, counting data access topological characteristics to calculate a cache value score, determining an optimal cache position according to an access mode, monitoring a task migration event to execute cache cooperation migration, and periodically re-evaluating to dynamically adjust the cache based on a buffer mechanism. The technical problem that a traditional caching strategy neglects that tasks depend on spatial locality and do not respond to task migration in a cooperative mode is solved, and intelligent cooperative optimization of caching data layout and task distribution is achieved.

The invention belongs to the technical field of data processing, and particularly discloses a high-performance and false-positive-free cuckoo filter design method, which is characterized in that a one-to-one correspondence relationship between elements and hash values is realized through unique hash mapping, and false positive is eliminated fundamentally; and meanwhile, a multi-candidate bucket mapping strategy of the main bucket group and the auxiliary bucket group is utilized, and the cache locality is improved in combination with relative distance coding, so that the element migration frequency under high load is effectively reduced. The filter provided by the invention has constant time complexity in insertion, query and deletion operations, and realizes excellent space utilization rate and throughput performance while keeping zero false positive rate. The structure is particularly suitable for data processing scenes such as network data filtering, intrusion detection, firewall matching and malicious traffic identification which have extremely high requirements on accuracy and real-time performance.

The invention discloses a DMA (direct memory access) scheduling system, method, equipment and medium based on task order preserving, and relates to the technical field of data transmission, which comprises the following steps: splitting tasks and sequentially sending read requests by utilizing a DMA task splitting and read request sending module, receiving data by a transmission data receiving module, and sequentially transmitting the data to equipment to be written by a write request sending module, the data caching module caches data; meanwhile, a fixed cache position is applied for each to-be-received DMA task in advance, a lookup table is established based on labels to accurately position out-of-order data, and effective marks are set for the cache positions to guarantee sequential execution of the tasks. The technical problems that the utilization rate of multi-channel shared cache resources is low, out-of-order tasks need additional caches and are high in sorting delay, and continuous read requests of the same channel are prone to sequence errors are solved, the multi-channel shared cache is supported, hardware resources are saved, the concurrent performance of the read requests of the same channel is improved, the DMA tasks can be processed in an order-preserving mode without additional sorting caches, and the service life of the DMA tasks is prolonged. And the technical effects of system performance and resource efficiency are considered.

The invention relates to a data processing method and device, computer equipment and a storage medium. The method comprises the following steps: in response to a current processing request, determining a storage condition of to-be-processed data in an annular cache queue; determining the consistency between the current processing request and the historical processing request under the condition that the to-be-processed data is stored in the annular cache queue; under the condition that the current processing request is consistent with the historical processing request, updating the cache position of the to-be-processed data in the annular cache queue according to the current processing request; and under the condition that the head pointer in the annular cache queue moves to the cache position corresponding to the to-be-processed data, processing the to-be-processed data based on the current processing request. By adopting the method, storage space waste can be avoided.