47 results about "Client cache" patented technology

The invention discloses a storage and calculation separation key value storage delay optimization method based on prediction driving, and aims to solve the problems of performance bottleneck and high tail delay caused by passive management and high network delay in a key value storage system in a storage and calculation separation scene. The method comprises the following steps: time load prediction: deploying a time sequence prediction model at a client, and predicting a future read-write request based on a historical access sequence; active cache prefetching: according to the predicted read request, actively preloading hotspot data from a server side to a client side for caching so as to improve the cache hit rate and hide network delay; active write-in optimization: according to the predicted write request, executing maintenance at a server side through predictive pre-insertion and active node splitting, and moving high index structure adjustment overhead out of a key request path to eliminate a write delay peak; and structure sensing batch synchronization: pre-fragmenting a local write buffer by using a server index top layer model of a client cache, and combining multiple independent remote insertion operations into one efficient batch update to reduce data synchronization overhead. Compared with an existing passive management system, the characteristics of model prediction and active cooperation are fully utilized, and the average delay and the tail delay of the system are reduced.

The invention discloses a distributed file system metadata index optimization method based on remote direct memory access, which comprises directory metadata index based on path name hash: defining a plurality of layers of directories in a directory tree as key directories, and regarding the path as a character string. After calculation of the hash function, determining the storage position of the data in the memory of the metadata server of the distributed file system; and optimizing the memory position of the file metadata based on the popularity, namely placing the file metadata which is frequently accessed at a position adjacent to the key directory metadata to which the file metadata belongs. A metadata management module in a metadata server of the distributed file system regularly checks the popularity of the file and carries out cold and hot migration according to the situation; and client cache optimization oriented to key directory metadata: a metadata cache of a distributed file system client caches the metadata and directory entries of the key directory. Optimally assuming that the metadata and directory entries of the key directory in the cache are not invalid, and updating the cache according to the result of the next-level metadata search. According to the method, the remote reading performance of the metadata index of the distributed file system is optimized by fully utilizing the characteristic of remote direct memory access, the network transmission frequency is reduced, and the load of the metadata server is effectively reduced.

The embodiment of the invention provides a data processing method and device, equipment, a storage medium and a program product. Comprising the steps of judging whether a transmission mode of an application layer for a to-be-written data write request is a direct read-write mode or not; if the mode is not the direct read-write mode, continuing to judge whether a client cache mechanism is started or not; if the client cache mechanism is started, continuing to judge whether the to-be-written data or metadata of a parent directory of the to-be-written data carry a cache acceleration mark or not; if the to-be-written data or the metadata of the parent directory of the to-be-written data carry a cache acceleration mark, obtaining the size of an idle memory block of a preset cache; when the size of the free memory block is greater than or equal to that of the to-be-written data and the to-be-written data is not overlapped with the data in the preset cache, storing the to-be-written data in a memory block pre-allocated by the preset cache; and traversing the memory block list of the preset cache, and storing the to-be-written data to the target storage. The method is used for achieving the effect of improving the data processing performance.

An address translation system, method and device including a translation extension unit associated with a client and having a client address translation cache storing a client cache of the address translations. When virtual address of a translation request from the client is the same as the virtual address of an address translation of the client cache, the translation extension unit returns the physical address that is mapped to the virtual address according to the address translation to the client without transmitting the translation request to a memory management unit that maintains a page table of all the translations and a translation lookaside buffer with a subset of the translations.

The invention provides a Web page access method, device and equipment, and the method comprises the steps: receiving and responding to a first user access operation at a first page of a first application, and obtaining user access information which comprises a second application page identifier; under the condition that the client cache does not comprise the second application page information, a page loading request is sent to a first server side, and the page loading request is used for the first server side to obtain the second application page information from a second server side; obtaining the second application page information; and loading the second application page according to the second application page information. According to the application, the main application and all the sub-applications run in the homologous and same-domain environment, so that the mixed access of the sub-applications and the main application can be realized, and the development of the main application is not limited by languages.

The invention discloses an anti-quantum security enhancement method for an open identity connection protocol, particularly relates to the technical field of distributed identity authentication, and is used for solving an identity hijacking risk caused by client public key update lag in an anti-quantum cryptography high-frequency key rotation scene of an existing OIDC protocol. A version identification public key fusing a timestamp and Hash is dynamically generated through an identity provider, and change notification broadcast of multicast / fragment routing is realized based on historical response of a client and network topology characteristics; the relying party client accurately requests a new version public key, and updates the local cache after verification; constructing an anomaly detection model in combination with the key version dispersion and the update frequency standard deviation, and triggering a security level adaptive dynamic threshold rollback mechanism; quantum security key synchronization, client cache abnormity real-time self-healing and network resource optimization are realized, and an attack window in a key rotation period is eliminated.

The invention provides a data caching method and device, a storage medium and a program product, firstly, an SQL statement of a client side is analyzed to obtain a name information hash value and an SQL feature hash value corresponding to the SQL statement, then according to the name information hash value and the SQL feature hash value, hierarchical management is conducted on the SQL statement according to a preset caching mechanism to distinguish hot data and cold data, and the SQL statement is cached according to the hot data and the cold data. Wherein the preset cache mechanism comprises an LRU mechanism of hot data and an LFU mechanism of cold data, then obtaining context information during the execution period of the SQL statement, mounting the context information to a corresponding handle generated by hierarchical management, and then adding the handle to a client cache system. The cache resources are subjected to hierarchical management, hot data and cold data are distinguished for classified processing, the cache hit rate is increased, and therefore the client application response speed and the user experience are effectively improved.

The invention provides a serial number acquisition method and a serial number management system, and the serial number acquisition method applied to a client comprises the steps: receiving a common serial number acquisition request sent by a business application; under the condition that the number segment of the common serial number in the client cache meets a preset condition, according to the number segment of the common serial number in the client cache, sending a first number of common serial numbers requested by the common serial number acquisition request to the service application; and under the condition that the number segment of the common serial number in the client cache does not meet a preset condition, sending a first number of common serial numbers requested by the common serial number acquisition request to the service application according to the number segment of the common serial number in the client cache, and sending a number segment acquisition request for requesting to acquire the first number segment to the corresponding server, and supplementing the obtained first number segment into the client cache. Therefore, the request pressure of the server can be relieved, the response speed is improved, and seamless connection of the serial number resources is realized.

This disclosure relates to an access control method and system, a client, a server, and a storage medium. The method includes: when a user logs into the system, obtaining basic user information and access information from the server, wherein the access information includes a first access time; caching the access information on the client; rendering the client interface based on the access information; sending an operation request to the server, wherein the operation request includes the first access time, so that the server can compare the first access time with a second access time in the database; receiving response data returned by the server, wherein the response data includes an access time field; and rendering the page based on the response data. In this disclosure, if a user's access permissions are changed, the user can directly obtain the latest access data when making an operation request, and the client can directly render based on the latest access information without needing to make additional user access permission requests.

The invention discloses a parallel read-write acceleration device based on a distributed file system client cache, which comprises a write cache module used for writing data into chunk according to a data write-in request and marking the data as a dirty state; when the chunk is fully written or no data is written within a preset time, pressing the chunk into a write shared thread pool; the parallel writing module is used for writing the data into the distributed storage cluster in parallel through a writing thread in the writing shared thread pool; the parallel reading module is used for reading data into a plurality of chunks in advance through a plurality of reading threads in a reading shared thread pool; and the read cache module is used for reading corresponding data from the plurality of chunks according to the data read request and returning the data to the read client. According to the method, the small I / O requests are aggregated through a cache mechanism, and concurrent writing and concurrent pre-reading are combined, so that the delay between writing of the data from the sending end and reading of the data from the receiving end can be remarkably reduced, and the effective bandwidth is improved.

The present application discloses a method for lightweight processing of WebGIS three-dimensional geographic data, which relates to the technical field of building information model data processing. Two-dimensional plane feature data is obtained from the three-dimensional geographic data, and plane line features and spatial line features are extracted. The plane line features and spatial line features are stored on the server side, and the spatial rendering data in the three-dimensional geographic data is mapped and stored in the client cache. When accessing the GIS server to view the three-dimensional geographic data, according to the area in the plane line features currently selected by the client, the corresponding rendering data is retrieved from the client cache to render the three-dimensional geographic data in the selected area of the plane line. After preprocessing and splitting the three-dimensional geographic data, the line three-dimensional data on the GIS server side and the spatial rendering data cached on the client side enable the client to quickly view the three-dimensional geographic data, and while achieving lightweight data on the GIS server side, it does not affect the display of three-dimensional geographic information on the client.

The application provides a data processing method and device, electronic equipment and a storage medium. In a case where at least part of data in a data set including a plurality of data in a server is cached in a client, a version number corresponding to an upper-lower cascade relationship between a version number of at least part of data cached in the client and a version number of at least part of data in a hierarchical tree is obtained. Based on the detection order from the version number in the upper node to the version number in the lower node in the upper-lower cascade relationship and the hierarchical tree in the server, whether at least one data of at least part of data has been updated in the server is detected. Through the application, the amount of data to be detected (the number of times of comparing version numbers) can be reduced, and the detection efficiency can be improved.

Embodiments of the present disclosure provide a table data processing method, device, equipment, medium and product. The method comprises: receiving, by a client, a data viewing request for a target table, and determining a first editing time corresponding to first table data requested to be viewed; wherein the client stores second table data corresponding to the target table at a second editing time; in the case that the first editing time is later than the second editing time, determining, according to the first editing time and the second editing time, to-be-changed data in the second table data corresponding to the data viewing request; backing up the to-be-changed data, and displaying the first table data in the client according to the second table data and the backed-up to-be-changed data. The technical solution achieves the effect of constructing the table data requested to be viewed according to the stored table data, and further achieves the effect of effectively saving the resource occupation space of the client on the basis of ensuring that modifying the stored data does not affect the client cache.

This invention relates to a lock-free I / O scheduling method, apparatus, and storage medium for cloud PCs. Responding to a client session request initiated by a client, the method controls a metadata coordinator to allocate storage nodes to the client and, within those storage nodes, allocates I / O shards for the client, obtaining allocation information. The metadata coordinator then returns the allocation information to the client, and the client caches this allocation information to facilitate the use of the allocation information to fulfill I / O requests. Each I / O shard includes an I / O thread bound to a first CPU core, a data plane development toolset driver, a storage performance development toolset driver, a first lock-free circular buffer, and a second lock-free circular buffer. By binding the CPU core and using lock-free circular buffers, thread switching, lock contention, and most memory copying are eliminated, reducing I / O processing latency from milliseconds to hundreds of microseconds and significantly reducing latency jitter.

The invention discloses an optimization method and system for frequent Rpc pulling of non-real-time data. The optimization method comprises the steps that a server cache version number is configured for first data obtained by a server according to a timestamp; when the client side obtains data from the server side through the Rpc for the first time, first data and a server side cache version number are obtained and cached to the local of the client side, and interface calling time is updated; when the client requests required data later and the interval between the interface calling time and the current time exceeds a preset time interval, the server cache version number is pulled from the server through the Rpc interface; when the cache version number of the server side is inconsistent with the cache version number of the client side, pulling required data from first data of the server side through the Rpc; and otherwise, pulling the required data from the second data of the client. According to the method and the device, the frequency of calling the data from the server through the Rpc and the loss of interface performance can be reduced, the acquisition efficiency of the non-real-time data is improved, and the method and the device can be applied to the technical field of computers.

To provide a method for managing biological image data in a client cache in a digital pathology analysis system.SOLUTION: Each of the digital pathology system and the server system includes maintaining a cache that is pre-populated with biological image data including pre-processed biological image data in a destination file format, wherein the cache can be populated with the biological image data on the digital pathology system and / or the server system to obtain the biological image data to facilitate real-time or near real-time visualization of the biological image data in a browser or the digital pathology system. The biometric image data on the server is automatically pre-processed upon receipt of the scanned image data.SELECTED DRAWING: None

The embodiment of the invention provides a table data processing method and device, equipment, a medium and a product. The method comprises the following steps: receiving a data viewing request for a target table through a client, and determining first editing time corresponding to first table data requested to be viewed; wherein the client stores second table data corresponding to the target table at the second editing time; under the condition that the first editing time is later than the second editing time, determining to-be-changed data corresponding to the data viewing request in the second table data according to the first editing time and the second editing time; and backing up the to-be-changed data, and displaying the first table data in the client according to the second table data and the backed-up to-be-changed data. According to the technical scheme, the effect of constructing the table data requested to be checked according to the stored table data is achieved, and then the effect of effectively saving the resource occupation space of the client on the basis of ensuring that the storage data is modified without influencing the cache of the client is achieved.

The invention provides a web interface data caching method and system, and the method comprises the steps: carrying out the standardization processing and weight correction processing of a parameter set in sequence, and obtaining an enhanced cache key; retrieving cache data matched with the enhanced cache key in a client cache to obtain a matching result; according to a matching result, obtaining a dynamic cache capacity upper limit after network delay compensation based on the maximum cache amount and the real-time network delay; further obtaining a final cache capacity upper limit; according to the final cache capacity upper limit, the current total cache amount of the server side is judged, and a judgment result is obtained; dynamically adjusting the final cache capacity upper limit based on the judgment result; performing data elimination on the cached data based on the predicted access times and the final access timestamp, and generating an elimination result at the same time; and adjusting the final capacity upper limit again based on the elimination result. The capacity upper limit is dynamically adjusted according to the average response time, and the response time fluctuation range is narrowed.

The application relates to the field of data processing, and discloses a multi-level cache method and device, a computer device and a storage medium. The method comprises the following steps: receiving a first cache update request sent by a client and containing user application setting information; checking whether cache update data matched with the user application setting information exists in a service end cache layer by layer according to the user application setting information; when it is detected that the cache update data matched with the Mth layer in the N-layer application setting information does not exist in the service end cache, sending a second cache update request to a remote database; obtaining database update data returned by the remote database in response to the second cache update request, so as to update the service end cache; obtaining the cache update data matched with the user application setting information from the updated service end cache; and sending the cache update data to the client to update the client cache. The application improves the data processing performance and enhances the user experience.

The embodiment of the application provides a video pre-distribution method and system, which is used for making a client predict a video based on data with higher real-time performance, and improving the accuracy of the pre-distributed video. The method comprises the following steps: a client sends video playing behavior data to a server; the server generates video features based on the video playing behavior data; the server recalls a to-be-watched video list based on the video playing behavior data; the server sends the video features and the to-be-watched video list to the client; the client acquires local user behavior and video playing records; the client determines a local to-be-played list according to the video playing records; the client determines to-be-predicted video features according to the video features, the local user behavior, the to-be-watched video list and the local to-be-played list; the client determines a first to-be-cached video according to the to-be-predicted video features; and the client caches the first to-be-cached video.

The invention discloses a multi-stage caching method for accelerating AI (artificial intelligence) data processing, which belongs to the technical field of artificial intelligence data processing, and specifically comprises the following steps: creating a data processing pipeline, inserting a caching operation and marking a position, setting a caching client, a caching server and a shared space, and interacting the caching client with the data processing pipeline. The cache server stores a cache data set, the cache client and the cache server perform data transmission by using a gRPC framework, a data processing assembly line is converted into a graph structure and verified, the graph structure is converted, an execution graph is generated and an operator is optimized, and the data processing assembly line performs data processing according to the execution graph. And the cache client is called to communicate with the cache server, and write-in and read operation of the cache data set is executed, so that the AI data processing speed can be improved.

The invention discloses a random prefix domain name attack protection method based on cache hit probability. According to the method, a cache hit rate statistical item is created for each client on a recursive server, the cache hit rates of the clients and the global cache hit rate are updated in real time, and potential attack behaviors are identified by comparing the deviation between the clients and the global cache hit rate. When the cache hit rate of the client is lower than the global hit rate and exceeds the preset threshold value, the system intercepts recursive query, so that random prefix domain name attacks are effectively prevented. Through time window division and a real-time counting updating mechanism, the real-time performance and the dynamic adaptability of detection are ensured, the resource consumption is remarkably reduced, the attack detection accuracy is improved, and the safety and the stability of a DNS system are enhanced.

A client updates a display of a user interface associated with a state-based client-server application in accordance with a client-side cache. The server supplies data for a new state and additional data for one or more subsequent states that possibly follow the new state if appropriate one or more operations are performed. When a client request is generated that indicates an operation that causes the application to transition to the new state, the client updates the display in accordance with the data that corresponds to the new state from the client-side cache, if available from the client-side cache. The new state data is available since the server has previously supplied the new state data.

The present invention provides a multi-level caching network file system management method, comprising: an application software requests a file from a client, and the client searches a local cache; if the client's local cache misses the file, the client reads the file from a server, obtains a time attribute of the last modification to the file, returns the file to the application software, and simultaneously saves the file and the time attribute of the last modification to the local cache. The present invention utilizes multi-level caching technology to reduce the number of synchronous interactions between the client and the server, thereby improving the read and write performance of the onboard system; and efficiently implements incremental transmission of cached file data between the server and the client through the rsync algorithm, thereby ensuring the correctness and consistency of the cached file data between the server and the client to a certain extent.

The invention discloses a ship equipment data acquisition method and system based on Springboot, and the method comprises the following steps: S1, building different types of communication clients based on the public configuration and injection mode of Springboot; s2, adding the created different types of communication clients into a client cache queue, and waiting for starting of an external trigger instruction; s3, after a trigger instruction for a target communication client is detected, starting a message communication function of the target communication client, receiving message data in real time through the target communication client, and then storing the received message data into a cache; s4, reading the message data from the cache, and performing analysis processing on the message data through the target communication client to obtain analysis data; and S5, storing the analyzed data in different databases / tables in a classified manner. According to the invention, message communication between diversified communication protocols and equipment of different suppliers is supported, and rapid acquisition and expansion of ship equipment data can be realized.

The invention discloses a data query method and device, electronic equipment and a storage medium, and relates to the technical field of big data or other related fields, and the method comprises the following steps: receiving a data query request and query conditions; accessing the client cache based on the query condition, and generating a data query result based on a first access result when the returned first access result is not empty; when the first access result is null, accessing a server cache based on the query condition, and when a returned second access result is not null, generating a data query result based on the second access result; and under the condition that the second access result is empty, accessing the server memory based on the query condition, and generating a data query result based on a returned third access result. Through the method and the device, the technical problem of low response speed of front-end large data volume query in related technologies is solved.

The present invention proposes a method and system for web interface data caching, comprising: sequentially normalizing and weighting a parameter set to obtain an enhanced cache key; retrieving cache data matching the enhanced cache key from a client cache to obtain a matching result; based on the matching result, obtaining a dynamic cache capacity upper limit after network delay compensation based on a maximum cache capacity and real-time network delay; then further obtaining a final cache capacity upper limit; judging the current total cache capacity of the server based on the final cache capacity upper limit to obtain a judgment result; dynamically adjusting the final cache capacity upper limit based on the judgment result; eliminating cached data based on a predicted number of accesses and a last access timestamp, and generating an elimination result; and re-adjusting the final capacity upper limit based on the elimination result. The present invention dynamically adjusts the capacity upper limit based on the average response time, thereby reducing the range of response time fluctuations.

The invention provides a data loading method, device and system, equipment, a cluster, a medium and a product. The method is executed by a client side and comprises the steps that a data loading request is obtained, and the data loading request is used for loading data corresponding to a thematic page; the data loading request carries a scene application identifier; a front-end loading module set is determined according to the scene application identifier, the front-end loading module set comprises one or more front-end loading modules associated with the scene application identifier, and the front-end loading module set comprises a first front-end loading module; a dependency library set is obtained according to the front-end loading module set, the dependency library set comprises at least one of a first type of dependency libraries and a second type of dependency libraries, the first type of dependency libraries are used for indicating dependency libraries cached by the first client, and the second type of dependency libraries are used for indicating dependency libraries not cached by the client; and displaying the thematic page according to the dependency library set.

The invention discloses a global unique ID (Identity) strategy implementation method based on preloading and client caching. The method aims to solve the problems of performance bottleneck, single-point fault risk, global uniqueness guarantee and the like faced by global unique service identifier generation in a distributed system. Number segments are pre-allocated from a database in batches through a number sender system, and a client locally caches and automatically increases a consumption ID, and asynchronously requests a new number segment when the number segment is about to be exhausted. And the database is used as a final adjustor in the strategy, and the unique non-overlapping distribution of the number segments is ensured through transactional locking. According to the method, high-performance, high-availability, globally unique and approximately ordered ID generation under high concurrency is realized, and the loading capacity and reliability of the system are remarkably improved.