203 results about "Distributed cache" patented technology

The invention discloses a distributed computing task non-perception migration method and system under optical fiber network interruption. The distributed computing task non-perception migration method comprises the following steps: constructing a distributed task migration system and an output system architecture; collecting network state indexes, constructing a network topological graph, and analyzing the state of an optical fiber link for fault prediction; obtaining a calculation task operation state, establishing a sub-task mapping relation, constructing a directed dependency graph, and generating a state snapshot; analyzing resource requirements, reserving standby resources, and deploying a distributed cache system; analyzing a fault influence range, extracting an influenced calculation sub-graph, and selecting a migration target node; in a target node preloading environment, reconstructing an execution context, and redirecting a communication path; and setting a data change capture mechanism, synchronizing incremental data and executing consistency verification. According to the method, non-perception migration of the computing tasks is realized, task continuity and data consistency are guaranteed, and the reliability of the distributed computing system in an optical fiber network fault scene is improved.

The invention discloses a data migration method and device, computer equipment and a storage medium, and realizes a data migration processing mode oriented to an unstable network environment by combining neural network prediction, decision tree anomaly recognition and a distributed cache mechanism. Therefore, the data transmission stability and the migration task completion rate in the cross-network environment are obviously improved. Firstly, a pre-trained neural network is utilized to carry out deep prediction on a real-time network state, and a potential performance reduction trend is identified in advance, so that a migration process can actively adjust a path or a strategy before a risk occurs. And secondly, by performing decision tree identification on a data packet sending sequence, the system can position a potential interruption point based on fine-grained time sequence characteristics, and quantify the risk in an interpretable manner, so that migration control can be accurate to a specific data packet level. Finally, under the condition that the risk is unacceptable, the system automatically activates a distributed cache mechanism, and the durability and the restorability of the data are guaranteed in a redundant copy storage mode.

The invention discloses a database access parameter real-time cooperative processing method and device based on multi-level cache, and belongs to the technical field of computer data caching. The method comprises the steps that a version number management table is configured; establishing a four-level cache architecture of a transaction-level cache layer, a process-level cache layer, a distributed cache layer and a database cache layer; receiving a transaction request, creating a transaction level cache layer and loading current version number information; comparing the version number in the transaction level cache layer with the version number in the process level cache layer; according to the version number comparison result, obtaining parameter data from the corresponding cache level according to a preset cache access priority strategy; and when the parameter change is detected, updating the corresponding version number in the version number management table, and updating the cache layer data as required. According to the method, real-time global effectiveness of parameter change is realized, parameter consistency of in-transit transaction is guaranteed, system processing performance and throughput are improved, system reliability and fault-tolerant capability are enhanced, and system resource utilization rate is optimized.

The invention provides a request parameter value authority authentication method and system, and relates to the technical field of network security, and the method comprises the steps: creating an access control list configuration and binding a service when a gateway registers the service, building the association mapping of a consumer and the service, and setting a parameter authority list; encrypting the sensitive field by adopting an advanced encryption standard algorithm and synchronizing the sensitive field to a distributed cache; and verifying the validity of the token when the service request is received, verifying the authority of the consumer, and verifying the parameter value. According to the invention, unauthorized access can be effectively prevented, the system security is improved, and the authentication efficiency is improved through the distributed cache.

The invention discloses an ICS-oriented efficient multi-source data interaction method and system, and relates to the technical field of intelligent power plant ICS data communication. According to the method, interaction variables are limited through a backboard bus agent, and the data interaction security is improved in combination with a dual-access security control mechanism; a multi-link communication architecture fusing optical fiber, 5G and industrial Ethernet is constructed, transmission tasks are dynamically allocated by using an intelligent scheduling algorithm, and a communication procedure and a coding strategy are adaptively adjusted, so that the data transmission efficiency and reliability in different network environments are improved; a distributed cache unit is deployed at each server node, and the data access delay is reduced in combination with a cache consistency regulation and an intelligent scheduling and prefetching mechanism; through an omnibearing fault perception and parallel rapid switching algorithm, rapid takeover under a fault condition is realized, and service continuity is ensured in cooperation with data consistency; the method can be widely applied to industrial control systems with high requirements on data interaction safety, real-time performance and reliability, such as intelligent power plants.

The invention provides an invoicing data asynchronous concurrent processing method and system based on a message queue, and the method comprises the steps: receiving invoicing application data of a business system through a tax platform, carrying out the basic format verification of the invoicing application data, asynchronously pulling an invoicing application message from a message queue through a consumption cluster composed of one or more message consumers, and transmitting the invoicing application message to a server; judging whether all the preset service rules are met or not; if all the preset business rules pass the verification, pushing the verified invoicing application data to a tax center, and initiating an automatic invoicing request; generating a final result of invoicing processing; and persistently storing a final result of invoicing processing in a database or a distributed cache, and feeding back the final result to a service system through an asynchronous notification mechanism. Complete decoupling of requests and processing is realized, the throughput and concurrency capability of the system are effectively improved, the stability and fault tolerance of the system are enhanced, the maintainability and flexibility are improved, the impact on a downstream system is reduced, and elastic expansion and automatic operation and maintenance are supported.

The invention provides a load migration method and system for balancing the energy efficiency of a server cluster, and relates to the technical field of distributed computing. According to the method, the power consumption data of the distributed cache nodes in the server cluster are acquired, and the high-power consumption nodes and the low-power consumption nodes are identified; meanwhile, access frequency data of the cache data fragments are obtained, and cross-node unified sorting is carried out to generate a global access popularity result; based on the popularity sorting and the power consumption data, determining a fragment with the highest access popularity in the high-power consumption nodes as a fragment to be migrated, and selecting a low-power consumption node with sufficient resources as a target node to form a migration decision; updating a cluster metadata mapping relation, establishing a data transmission channel, asynchronously copying data blocks in batches, and verifying the data blocks; and after completion, switching a client route, and pointing the request to a target node. Energy efficiency balance of the server cluster can be realized, the overall power consumption is effectively reduced, and the resource utilization rate is improved.

The invention discloses an Ethernet-based distributed cache coherence protocol, an implementation method, an implementation device and an implementation system. A plurality of computing nodes are connected through a packet switching network. Each computing node comprises a CPU / GPU (Central Processing Unit / Graphics Processing Unit) and a local cache thereof, and is provided with a cache agent. The far-end memory is organized in home nodes, and each home node manages a part of physical address space and is equipped with a directory controller. When the CPU of the computing node accesses a far-end memory address and does not hit in the local cache, the CA of the computing node replaces the far-end memory address and communicates with the DC managing the address through the network so as to maintain the cache consistency of the data among all the nodes. Based on a cache consistency protocol of a directory, the CXL.cache consistency of a plurality of independent computing nodes can be maintained in a low-overhead and high-reliability mode on a high-delay and lossy packet switching network, and broadcast storm caused by a monitoring protocol is avoided.

The invention discloses a graph database query acceleration method and system. The method comprises the following steps: constructing panoramic query observation data through non-intrusive log interception and structured processing; the query statement is analyzed into an abstract syntax tree, semantic normalization processing is carried out, and a unique hash value is generated; predicting a hotspot query template and high-frequency parameters thereof based on a popularity value score model, and asynchronously preloading a result to a cache; dynamically calculating adaptive survival time for each cache item according to the data change frequency and the access popularity; and constructing a multi-level cache architecture comprising a local cache, a distributed cache and a database built-in cache, and performing intelligent routing and collaborative backfilling based on a hash value. According to the method, intelligent and transparent acceleration of graph database query is realized, the query performance is remarkably improved, the database load is reduced, and the problems of redundancy, high cold start delay and difficulty in balancing cache consistency caused by grammar difference in traditional cache are solved.

The invention relates to a distributed storage cache hotspot prediction method and system based on an access mode. The method comprises the following steps: acquiring an access log to obtain original data; the gradient change of the access frequency between the adjacent data blocks is analyzed in real time to divide the hot spot range and identify continuous hot spot data blocks; constructing a time sequence based on the historical access record, and pre-judging an access hotspot in a future time period by applying a time sequence trend prediction algorithm; constructing a multi-dimensional feature vector and inputting the multi-dimensional feature vector into a machine learning prediction model to output a hotspot probability of the corresponding data object in a future time period; according to the hotspot probability and a popularity threshold value, scheduling the data predicted as the hotspot into a cache, and allocating corresponding cache levels or storage paths for the data objects with different popularity at the same time; and periodically updating the prediction model and the popularity statistics to obtain dynamic prediction and cache optimization of the hotspot data. According to the invention, the prediction of the hotspot data is realized, and the hit rate and the system performance of the distributed cache are improved.

The invention provides a distributed cache management method, system and device, a storage medium and a program product, and is applied to a distributed cache management system which comprises a business application node, a database node and a cache data service node. Each running business application process in the business application nodes comprises a cache software development tool SDK and a local cache component, and the method comprises the steps that when data in a database node is changed, a first cache SDK obtains a data change event in a cache data service node; the first cache SDK obtains change data in the database node according to the data change event; and the first cache SDK updates cache data in the first local cache component according to the change data. According to the scheme, the local cache in the distributed system can be effectively managed.

The invention discloses a performance monitoring system and method for expansion and upgrading of a big data platform, and relates to the technical field of big data analysis. According to the performance monitoring system and method, key information of newly-added Web servers is collected to form a standardized configuration data set, and node deployment normalization and cluster compatibility in the expansion stage are improved; operating load logs before capacity expansion are directionally pulled and screened, and a historical cluster server operating load set is constructed through structural analysis; first dynamic weight configuration is completed by combining two types of load sets, the cache types of the Web servers are distinguished according to cache configuration identifiers, and secondary weight adjustment is performed on the shared distributed cache Web servers based on the hit rate, so that the defects of existing weight configuration are overcome, accurate weight adaptation is realized, the cache hit rate is increased, the frequency of requesting to penetrate through a database is reduced, and the service life of the Web servers is prolonged. The database load is reduced, the response delay is shortened, resource imbalance and service instability are avoided, and the performance of platform expansion upgrading operation is guaranteed.

The invention belongs to the technical field of distributed cache, and relates to a dynamic hotspot data migration method of a distributed cache system. According to the method, the multi-dimensional operation state data is acquired in real time, and the real-time state data set is generated, so that the hysteresis quality and inadaptability of a traditional static fragmentation strategy in coping with hotspot data are overcome, and the sensing precision of system load distribution is improved; a dynamic linkage mechanism among hot spot prediction, migration cost simulation and node resource allocation is established, and a data migration path and a synchronization strategy are adjusted according to the difference of access trend parameters and node instantaneous processing capacity variation. The optimal matching between the hotspot data distribution and the node resource utilization rate and the dynamic balance between the service performance and the stability are realized; read-write request distribution in the data migration process is mastered in real time through background increment synchronization and flow cooperative control, a migration scheme is continuously optimized according to objective indexes, and the problems of service jitter and resource competition in the migration period are avoided.

The invention relates to the technical field of payment systems, in particular to a multi-level cache-based payment data disaster tolerance processing method and system, after a payment request is received and verified, data is synchronously written into a memory queue and a disk log by a log pre-writing mechanism, and then the data is asynchronously pushed to a Redis distributed cache cluster for backup; when a program is abnormal or a service is interrupted, preferentially recovering data from the Redis cache, and supplementing data missing from a disk log; after the fault is recovered, unpersistent data are synchronized to the database in batches, and the consistency of the fund flow water meter and the user balance meter is ensured through atomization operation; the reliability of payment data is improved through collaborative backup of multi-level caches, and the risk of data loss caused by dependence of a single cache is solved; and by virtue of a recovery mechanism of cache priority and log supplement, the fault recovery time is shortened, and the influence of transaction interruption is reduced.

The invention relates to a data interface high-concurrency processing method based on multi-level cache, and belongs to the technical field of computer software. According to the method, an SDK interface receives a user data query request; the request firstly arrives at the local cache, the system queries according to the Key, if the request is hit, the data is directly returned, and the process is ended; if the local cache is not hit, querying a distributed cache Redis; if the distributed cache is hit, returning the data to the user, and asynchronously writing the data back to the local cache for subsequent request use; if the Redis still does not hit, query is executed through the unified data access service; the database query result is backfilled to the distributed cache and the local cache, and a subsequent request can obtain data from the distributed cache and the local cache. Through an automatic adaptation mechanism, data consistency and access correctness among the databases are guaranteed, and the problem of cross-database compatibility is effectively solved.

The invention discloses a stacked chip architecture of a distributed cache and a chip. The stacked chip architecture comprises a logic calculation unit and a storage unit which are arranged in a stacked manner; the stacked chip architecture further comprises cache units, one cache unit is correspondingly connected with the logic calculation unit and the storage unit, the number of the cache units is multiple, and the multiple cache units are in topological connection; wherein the cache unit is used for storing a data address corresponding to the storage unit, and the logic calculation unit initiates a memory access request to the cache unit; if the memory access request hits the data address stored in the cache unit, returning the storage data of the storage unit to the logic calculation unit; and if the memory access request does not hit the data address stored in the cache unit, forwarding the memory access request to other cache units. According to the technical scheme, the requirement for high-bandwidth communication with the storage unit can be effectively met.

Method and system of delivering and administering tests remotely on a candidate device based on a test specification, wherein the test package contains the test specifications and test package is created and stored in a distributed cache and based on a minimal latency time, download and / or push the test package from the distributed cache to the candidate device and administer the test to the candidate, collecting the accruals and uploading the accruals for the test for assessment of the candidate.

The embodiment of the application discloses a memory retrieval method, a memory management method and a computer device. The method is used for the computer device, the computer device and a distributed cache, the computer device comprises a persistent storage, and the distributed cache and the persistent storage both store candidate memories. The method comprises the following steps: obtaining a retrieval request of a target user from a target terminal, extracting target query information from the retrieval request; if a target memory matched with the target query information is not obtained from the distributed cache, obtaining the target memory from the persistent storage, and sending a target retrieval result to the target terminal based on the target memory. The technical scheme can improve the interaction efficiency between the intelligent agent and the user by using the hierarchical storage memory.

The invention belongs to the technical field of civil airport digitization and informatization in the civil aviation industry, and discloses an airport production data access method and system based on multi-level cache. The method comprises the following steps: a terminal responds to an interface event, constructs a local buffer interface event and query interface name combination key, and constructs a query interface name and query parameter combination key; judging whether the event time of the local buffer interface event is smaller than the retrieved buffer timestamp or not; determining specific nodes corresponding to the distributed cache region in the terminal clustering group; judging whether the event time of the local buffer interface event is smaller than the retrieved data timestamp or not; judging whether the identifier of a certain service interface is encrypted or not, and finding out a certain interface mapping relation which can be matched; and traversal of the region set needing to create the copy is completed. According to the invention, cross-regional data access is reduced, network delay is reduced, and the efficiency of data access in the region is improved.

The application relates to the technical field of distributed data processing, in particular to a data collection and storage method and system, an organic light-emitting diode inkjet printing equipment and a storage medium. The method comprises the following steps: a collection client obtains a collection task of the organic light-emitting diode inkjet printing equipment; based on a preset data type classification rule, the collection task is split into multiple independent subtasks, wherein the number of the independent subtasks is adapted to the number of the collection clients; each collection client collects original data of the organic light-emitting diode inkjet printing equipment in parallel according to each independent subtask, and sends the original data to a master node of a distributed cache cluster; each master node receives original data of a corresponding type, divides a storage partition according to a type corresponding to the preset data type classification rule, and directly writes the original data into a local memory to complete real-time storage, so that the data storage delay of the organic light-emitting diode inkjet printing equipment multi-type data collection is low.

The invention relates to the technical field of block chains, in particular to a block chain tourism data privacy protection method and system, and the method comprises the steps: constructing a distributed cache layer which is disposed between a block chain node and a user terminal, and is used for dynamically capturing the newly-added tourism data of a user, and taking a preset time window or a data size threshold value as a unit; and aggregating the newly added tourism data into a data block group. According to the method, the distributed cache layer is constructed between the block chain node and the user terminal, the newly-added tourism data of the user is aggregated into the data block group according to the preset time window or the data volume threshold value, the situation that a complete privacy protection process is independently executed on each piece of newly-added data is avoided, and repeated operation and verification operation are reduced; double-layer encryption is adopted for a data block group, so that the basic data efficiency is guaranteed through lightweight symmetric encryption, and the group-level metadata security is enhanced through asymmetric encryption; and the fragmented parallel verification is started and the lock-free operation is realized by means of the message queue, so that the verification time is shortened.

The invention discloses a mail system based on a large client load sharing mechanism and a data processing method. The system is constructed based on a three-layer load sharing network architecture of a terminal layer, an intelligent virtualization processing layer and a core server layer. The intelligent virtualization processing layer is deployed between the terminal cluster and the core server layer, and is provided with a plurality of functional modules; comprising an intelligent prefetching cache module, an intelligent attachment cache module, a centralized full-text retrieval preprocessing module, a contact synchronization module, a calendar data pre-calculation module, a mail rule preprocessing module, a batch operation processing optimization module and a mail behavior analysis preprocessing module. According to the scheme, the bearing capacity of the creative mailbox system in a high-concurrency scene is remarkably improved, through distributed caching and intelligent pre-calculation, the core service response time is shortened, the hardware input cost is reduced, and the use experience of large-scale enterprise users is effectively guaranteed.

The invention discloses a processing method and device for sensitive data in a database, equipment, a storage medium and a product, and relates to the technical field of computers.The method comprises the steps that after a calling request for first target data is obtained, whether corresponding desensitized second target data exists in a cache or not is preferentially judged, and if yes, the second target data is directly obtained and fed back; if not, determining a load score based on the equipment CPU utilization rate and the memory utilization rate, and adaptively selecting the first or second desensitization algorithm in combination with the data access frequency to generate second target data; calculating a data thermodynamic score, only adding the high-thermodynamic score data to the cache, determining a migration priority according to the size of the data and the thermodynamic score, and shunting and storing the data to a local cache or a distributed cache; meanwhile, the data validity period is dynamically calculated based on the historical validity period sequence and the real-time access frequency, and expired data is timely cleared away to release resources. According to the method, the problems of performance bottleneck and resource waste of real-time desensitization in a high-concurrency scene are solved.

The invention provides a high-availability distributed cache query method and device, equipment and a storage medium, when a first instance node triggers an update event of index content, the index content in a memory of the first instance node is updated to obtain an update index corresponding to the first instance node, and the cache of redis is subjected to corresponding data version update, so that the update index of the first instance node is obtained. Before updating is completed, the old data version is available, and it is guaranteed that data in the updating process is available; and sending an updating signal based on an updating index corresponding to the first instance node to the redis channel through the first instance node, notifying a second instance node subscribing to the redis channel to update the corresponding updating index, and when a query index is received, querying corresponding query content from the updated data version in the redis according to the corresponding updating index and the query index, the deserialization overhead is reduced, and the query efficiency is improved.

This invention provides a method and system for dynamically updating a knowledge graph of an industry chain based on multi-source data, relating to the field of data processing technology. The method includes: obtaining information about industry classification nodes through a database query interface; performing multi-level sorting on the industry classification list composed of nodes; initializing an analysis template; when a user selects a node, triggering a subtree retrieval request; querying the direct sub-industry classification list based on the industry classification list; recursively searching for sub-industry classification nodes using lazy loading; constructing a classification subtree structure; building a multi-level caching architecture; storing the analysis template and frequently accessed classification subtree structures in a local memory cache; and storing the industry classification list and classification subtree structures in a distributed cache; querying and calling the template within the multi-level caching architecture; and outputting industry classification template data, thereby achieving closed-loop synchronization from data source changes to cache updates and then to front-end interface display, ensuring data consistency and providing a smooth, seamless user experience.

The invention provides a distributed cache management method based on a dynamic strategy engine, and relates to the technical field of computer software, and the method comprises the steps: configuring a cache strategy for each tenant through an intelligent cache strategy configuration center, the cache strategy comprises a cache granularity, a cache updating opportunity, a cache life cycle, a cache replacement strategy, a cache updating mode and a cache medium; receiving a cache strategy configuration change through a cache strategy dynamic engine, and performing hot update of the cache strategy based on the tenant identifier; generating cache strategy recommendation based on system runtime indexes and a machine learning algorithm through an intelligent strategy recommendation system; caching strategy gray release is carried out through a multi-dimensional gray release manager based on the user ID range, the regional distribution, the equipment type, the access time and the multi-dimensional configuration of the service module; and the final consistency of the cache and the database is realized based on the message queue through the cache consistency guarantee module.

This invention discloses a method, system, computer storage medium, and electronic device for querying payslips, relating to the field of financial technology. The method includes: obtaining a query request for a target payslip through a query system and identifying a customer ID in the query request; using the identified customer ID to determine whether the target customer has activated the payslip query function in the application, and obtaining a determination result; if the determination result indicates that the target customer has activated the payslip query function, selecting a target payslip for a target payroll period from a distributed cache system, wherein the distributed cache system stores payslips for multiple payroll periods from all accounts of multiple customers, and the target payroll period is a preset payroll period with the shortest interval to the current time; and feeding the target payslip back to the application. This application solves the problem in related technologies where customers find it difficult to efficiently obtain the payslips they need to query.

The application provides a multi-tenant multi-user login method based on enhanced OAuth2, relates to the technical field of network security, and comprises the following steps: obtaining a key threshold through a tenant identifier, performing OAuth2 authentication to obtain an access token; generating tenant fingerprint information by using zero-knowledge proof and homomorphic encryption, and generating a tenant verification token by using secure multi-party computation; combining historical access data to construct a reinforcement learning access controller, generating and verifying a permission list; and finally forming a session identifier and storing the session identifier to a distributed cache. The application improves authentication security, realizes cross-tenant fine-grained permission management, and effectively prevents unauthorized access.

The invention relates to the technical field of medical instrument delivery management, in particular to a medical instrument delivery center scheduling system and scheduling method based on intelligent queue management, and the technical scheme provided by the invention has the following beneficial effects: through a multi-order aggregation number taking function, a plurality of orders of the same supplier are allowed to be merged and processed, and the number taking efficiency is improved. One-time number taking of multiple orders is achieved, workers can process homologous orders in batches, suppliers do not need to go back and forth for many times, and the waiting cost is remarkably reduced. An intelligent queuing algorithm is realized based on order attributes, a first surgical instrument is preferentially processed, the operation is ensured to be carried out on time, urgent orders are automatically jumped, emergency medical requirements are met, a processing sequence is dynamically adjusted according to order importance, and resource allocation is more reasonable; distributed cache and WebSocket push technologies are adopted, real-time synchronization of queue states is realized, suppliers can check queuing progress and predicted waiting time in real time, information is more transparent, and high availability of services is ensured by a distributed architecture.

The embodiment of the specification discloses a mirror warehouse distributed cache method and device, wherein the method comprises: deploying a service for a plurality of data center mirror warehouses, deploying and running a cache service corresponding to each data center; in response to a first data center pulling a first image request instruction, obtaining corresponding first image metadata in the mirror warehouse; querying whether the first image block file corresponding to the first image metadata has been saved in the first data center cache; when not saved, saving the first image block file to the first data center cache service and sending the first image to the first cluster node of the first data center; when saved, sending the first image to the first cluster node of the first data center, wherein the first image comprises the first image metadata and the first image block file saved in the cache service of the first data center. The scheme can significantly reduce the mirror warehouse traffic pressure, improve the image pulling speed, and reduce the network communication cost.