69 results about "Eventual consistency" patented technology

The invention relates to a Raft-algorithm-based block chain consensus mechanism. The mechanism comprises: consensus node information of a block chain is stored into the block chain and an initial state of a consensus node is set to be a follower state; on the basis of a Raft algorithm, a consensus node of an initial leader state is selected by combining the height of the block, wherein the consensus node of the leader state is used for recording a transaction event and generating a new block; and at the end of the term of the consensus node of the leader state, a consensus node of a leader state is selected again. Because the height of the synchronous block is considered for reference during the consensus node selection process of the leader state, the consensus efficiency can be improved and the transaction confirmation time can be shortened; and because the consensus node is selected again at the end of the term, the system fault tolerance can be improved. Moreover, on the basis of uniqueness of the consensus node selection of the leader state, each block has final consistency, thereby avoiding block chain furcation. Meanwhile, dynamic entrance and exit of a consensus node can be realized based on a management mechanism of the consensus node by an intelligent contract.

The invention relates to a data range-based method for synchronizing data in a database. The method comprises the following steps of: segmenting the data stored in the database; determining a data segment with changed content; and updating the original content of the data segment. In the data range-based method for synchronizing data in database, provided in the invention, the data are segmented and then calculated by utilizing a Merkle Tree algorithm, compared and restored; the contents are synchronized among different data storage nodes in a large distributed data storage system to achieve the final data consistency.

A method for detecting ghost artifact in multiple images during high dynamic range (HDR image creation. For each pair of images, multiple individual consistency maps are generated by calculating a consistency function using moving windows of different sizes. The individual consistency maps are combined into a combined consistency map and then binarized. When combining the multiple individual consistency maps, they are first binarized using predetermined threshold values that are window-size-specific. The threshold values are developed beforehand using training images and machine leaning. The final binarized consistency map indicates whether the pair of images are consistent with each other at each pixel location. Then, a ghost-weight map is generated for each image based on the multiple final consistency maps. The ghost-weight map indicates the likelihood of each image pixel being ghost-inducing. The HDR image is generated using the set of images and the corresponding ghost-weight maps.

Techniques are provided for a linearizable primary-secondary database system that replicates database data with eventual consistency. The techniques include obtaining a logical clock value of a logical clock that orders transactions committed at a primary database system that includes a primary database. The logical clock value is obtained after a write transaction is committed at the primary database system and while processing a read request. The logical clock value is used to determine whether a secondary database is in a consistent replication state corresponding to the logical clock value with respect to the primary database. The read request is maintained in a linger state while the secondary database is not yet in the consistent replication state. The read request exits the linger state and is allowed to be processed against the secondary database after the secondary database has reached the consistent replication state.

Method and apparatus for replicating data structures over a network in which each data structure is assigned an owner node among a plurality of networked peer nodes. Preferably that owner can be ascertained through information in the data structure. When an update to the data structure is desired by a non-owner, a request to modify the data structure is sent out on the network and when received by the owner, the owner performs the modification. The owner node can then notify the other nodes regarding the update. The method, implemented through a single-writer, multiple-reader paradigm, insures availability, partition tolerance and eventual consistency; it avoids the high overhead costs and single point of failure drawbacks of the prior art centralized management and locking protocols. Administrators can connect to any peer node in the network to manage, monitor and request modifications to a data structure.

The invention relates to a method for maintaining an index and chain topological structure in a multi-level blockchain system, comprising: A, a top-level block chain indexes a lower-level blockchain by recording a next seed node in a transaction record of the block; B, a distributed monitoring cluster is maintained to periodically check the availability of corresponding IP addresses and ports under the seed node list recorded in the top-level blockchain; and C, each node of the lower blockchain needs to maintain a common global routing table structure to store the topological structure of theentire blockchain cluster, and maintain the final consistency of the global routing table through Gossip-based protocol propagation. The multi-level blockchain can quickly index the lower-level blockchain through the records in the blockchain; since the topological structure of the entire blockchain is maintained on the seed nodes, any client end can obtain responsive nodes in the entire blockchain through the seed nodes.

The disclosed embodiments provide a system for managing a materialized view of data in a data store. During operation, the system obtains a first creation time of a first materialized view of the data in the data store. Next, the system verifies that the first materialized view is not affected by deletions applied to the data since the first creation time. The system then identifies one or more additions to the data that are not included in the first materialized view. Finally, the system applies the additions to the first materialized view to maintain an eventual consistency of the first materialized view with the data store.

The invention discloses an intelligent consensus mechanism based on a two-way certificate and suitable for an intellectual property alliance chain, and aims to improve the consensus efficiency, shorten the transaction confirmation time and improve the system fault tolerance by adopting two kinds of certificates, namely a right-interest certificate and a circulation certificate. And on the other hand, as the PBS executes PoW mining in turn, the consensus calculation of system nodes can enable each block to have final consistency, the condition of block chain bifurcation is avoided, and meanwhile, the block output stability is also guaranteed. In addition, a winning accounting right reward of the system node is given to users with more stock rights and high participation degree, so that theactivity of the community can be improved; And the authorized and credible common full node participates in consensus calculation, so that the credibility and the internal transparency of the alliancechain operation can be improved.

The invention provides a distributed transaction solution under a micro-service architecture. The method comprises the following steps: a user client initiates a registration request to a front-end web server, and the front-end web server sends the registration request of the user to a user micro-service server; the user micro-service server processes a registration transaction event of the user and sends the registration transaction event of the user to a message-oriented middleware, and the message-oriented middleware forwards the registration transaction event of the user to an account micro-service server; and the account micro-service server processes the registration transaction event of the user. According to the distributed transaction solution provided by the invention, the reliable transmission and final consistency of messages can be ensured through the own transaction message re-transmission mechanism and transaction re-processing mechanism of each micro-service so as to ensure that the implementation of the scheme does not depend on the reliable transmission mechanism of the third-party message-oriented middleware, and thus the coupling with a certain type of message-oriented middleware can be weakened; and the abnormal loss of the transaction message events can be timely found and the transaction message events can be timely self-healed through the global audit and self-healing mechanisms.

The invention discloses a method for capturing movement data increment based on track change. The method comprises the following steps of enabling a trigger to capture operation logs; recording the operation change process of an operation data sheet; combining the operation logs by a purifying method, so as to capture the net increment and record the whole operation change process. The method has the advantages that the existing trigger mechanism of a movable database and the characteristic of lower writing frequency of movable nodes in the movable computing environment are sufficiently utilized, the increment capturing efficiency is obviously improved, the purifying operation is further adopted when the increment is extracted, the minimum increment data is ensured, the synchronous data communication amount is greatly reduced, the requirement of the synchronous system on the network bandwidth is lowered, and the communication cost is reduced; when the final consistency of the data is influenced because of the accidental interruption or severe timeout of the synchronous system, the operation change process can be used as the effective evidence for the rollback operation of the synchronous system, and the robustness of the synchronous system is improved.

The invention provides a method for realizing suspension prevention of distributed transactions. The method comprises the following steps of: receiving a first-stage request which comprises a global identifier; if a record which has a rollback state and has the global identifier in the first-stage request exists in a suspension prevention control table, considering that first-stage processing fails; otherwise, enabling a record which has an initial state and has the global identifier in the first-stage request to exist in the suspension prevention control table, and carrying out first-stage business processing; receiving a second-stage rollback request which comprises a global identifier; and enabling a record which has a rollback state and has the global identifier in the second-stage rollback request to exist in the suspension prevention control table, and carrying out business processing of second-stage rollback on the basis of the global identifier in the second-stage rollback request. Through the method provided by the invention, the initiators and participators of distributed transactions can avoid the transaction suspension caused by network jittering and the like, so as to ensure the final consistency of the distributed transactions; meanwhile, under a multi-branch transaction scene, the initiators only need to initiate submission or rollback requests to the participators for once, so that the performance of the distributed transactions is improved.

The invention provides a data reliable transmission method under a distributed network environment. The method comprises the following steps: a transmission server-side is deployed at a logic center of a distributed network environment so as to provide routing, caching and distributing service for the data transmission under multiple different network environments; a transmission client is deployed at the distributed network environment needing the data transmission, the data is transmitted to the transmission client in other distributed network environment through the transmission server-side based on the application data in the located distributed network environment. By use of a private data transmission protocol which is composed of a packet header and a packet body, the transmission data packet basic attribute definition is performed in the packet header, and the specific transmission content is deposited in the packet body; a data packet transmission process status tracking control strategy is further designed to perform real-time change and control on each status of the data packet; and the final consistency and integrity of the data packet are guaranteed in the network transmission process.

An apparatus for reconciling data inconsistencies between indexes may include a processor and memory storing executable computer code causing the apparatus to at least perform operations including retrieving first metadata from a key value store in response to receipt of a request for data associated with a user. The computer program code may further cause the apparatus to retrieve second metadata from a text index in response to querying the text index for the second metadata. The second metadata may correspond to the first metadata of the key value store. The computer program code may further cause the apparatus to evaluate the first metadata of the key value store and the second metadata of the text index to determine whether there are any differences between the first metadata and the second metadata. Corresponding methods and computer program products are also provided.

Computer-implemented methods for synchronizing data between a server and a client are provided. In one aspect, a method includes receiving a request from a client to synchronize data. The request includes a synchronization token that includes client recent synchronization signatures, each client recent synchronization signature representing a state of data synchronization on the client for a certain time period. The method also includes comparing each client recent synchronization signature with a corresponding server recent synchronization signature representing data on a server for the same time period. When the comparison indicates that the data on the client for the time period represented by the client recent synchronization signature is not synchronized with corresponding data on the server for the time period, then the method includes sending the data on the server for the time period to the client. Systems and machine-readable media are also provided.

The invention provides a data calling method for a service caller and a service called part, a data calling system and a computer-readable storage medium. The data invocation method for a service caller comprises the following steps: generating a service invocation request; Judging whether the calling interface of the service calling request is a preset data consistency interface; When the callinginterface is the preset data consistency interface, the message middleware sends the service invocation request and the interface metadata information of the invoking interface to the service calledpart, so that the service called part executes the service operation through the invoking interface. By adopting the technical proposal of the invention, subsequent storage, transmission and other processing are automatically carried out after invoking the data consistency interface with the specific annotation, so that the data consistency is ensured in each stage by transactions, and the concurrency capability and the usability of the system are greatly improved while the final consistency of the data is ensured.

The invention provides an adaptive allocation method and device and an adaptive replica consistency method. According to the adaptive allocation method, file heat of a file to be allocated at each time point can be calculated in real time, and the file heat degree value and a preset threshold at each time point can be judged; if the file heat degree value is larger than the threshold, the frequency, which is accessed by a user, of the file to be allocated is high, and in order to guarantee the user access efficiency, a replica strong consistency algorithm is allocated for the file to be allocated; if the file heat is smaller than the threshold, the frequency, which is accessed by the user, of the file to be allocated is low, and in order to avoid the waste of system resources, a replica eventual consistency algorithm is allocated for the file to be allocated. The aims of adaptively allocating proper replica consistency algorithms for different files, saving the network bandwidth and improving the overall performance can be fulfilled, and the problems that the system resources are wasted or the user access efficiency is low because only one replica consistency algorithm is used in all the files in the conventional distributed system are solved.

The invention discloses a system and a method for ensuring the eventual consistency of mass data caches. The system disclosed by the invention comprises a log monitoring module and a data cache eventual consistency batch-processing task module, wherein the log monitoring module is used for monitoring a binary data operation log of a practical data storage module and extracting change data records from the binary data operation log; the change data records comprise data records before and after changing; each data record is composed of a plurality of data columns; the data cache eventual consistency batch-processing task module is used for receiving the change data records, splitting the change data records into a plurality of change data columns according to columns, deleting unchanged data columns, only reserving changed data columns, combining the changed data columns by utilizing a reducer, and finally correcting the changed data columns; duplication of the change data records of the practical data storage module in a target data cache module is realized; and mass data cache consistency is realized. The system disclosed by the invention has high concurrency, batch-processing, high availability and the like; and the data cache consistency is realized by mapping, reducing and correcting batch-processing tasks.

The invention discloses a method for synchronously verifying and canceling receivable accounts in multiple angles, which breaks through the limit of the traditional software only meeting the verification and the cancel of single payment money, permits uses to verify and cancel the receivable accounts in two different angles, i.e. shipment and billing and can also synchronously automatically complete the verification and the cancel of the other side when verifying and canceling any side. The invention sufficiently utilizes the data structure incidence relation among an invoice, a receipt and apayment order and adopts a creative verifying and canceling frame and a logic and strict arithmetic to ensure shipment receivable and billing receivable to keep synchronous verification and cancel allthe time and strictly ensure the final consistency of two groups of verifying and canceling data under the condition that the traditional operation habit and the workload of a user are not changed, thereby meeting the requirements of enterprises synchronously managing the receivable accounts and extracting statistical data in different angles.

The invention relates to the technical field of micro-service development, in particular to a method for guaranteeing the data final consistency through a system based on a micro-service framework. Through the combination of a method using a message queue and the determination and retransmission mechanism of messages, final consistency can be achieved after automatic or manual compensation; modules related to the final data consistency include an upstream application for executing service and sending MQ messages, a reliable message service and message assembly for coordinating with the transmission of downstream messages and ensuring the consistency of upstream data and downstream data, and a downstream application for monitoring the MQ messages and executing service. The problems that traditional two-stage protocol submitting performance is poor and a processing chain is long are solved.

The invention discloses a method for synchronizing copies on the basis of partition state tables and coordinator nodes. The method is characterized in that the consistency of the copies is maintained by the aid of an authorized copy synchronization mechanism, storage nodes with copies required to be updated transmit synchronization requests to the coordinator nodes, the coordinator nodes judge whether the storage nodes meet copy synchronization operation executing conditions or not according to general partition state tables, and the storage nodes which meet the conditions are authorized to execute copy synchronization operation. The method for synchronizing the copies on the basis of the partition state tables and the coordinator nodes has the advantages that a duplicate detection rate for the consistency of the copies, a synchronization bandwidth occupancy rate and the sizes of inconsistent windows are greatly reduced, the problem of version conflict of multiple copies is solved, and the copy synchronization timeliness is improved; a distributed file storage system can quickly respond to external requests and can quickly detect the consistency of the copies, and accordingly the service capacity of the system and the final consistency efficiency are improved.

The invention provides message processing method, equipment and system. According to the message processing method and equipment, marker information is set for a message in a transaction operation process, and the message and the marker information thereof are transmitted to message equipment from application equipment. Meanwhile, transaction operation is carried out and the marker information is stored into a corresponding marker information database; and the marker information exists in the marker information database only if the transaction operation is finished. Therefore, the storage of the marker information of the message in the database and the completion of a transaction corresponding to the message have consistency; and a treatment manner of the transaction corresponding to the message is obtained by only inquiring whether the corresponding marker information exists in the marker information database of the application equipment. The message processing system provided by the invention comprises the application equipment and the message equipment; and the message and the transaction are unified through increasing a concept of the marker information of the message, and the problem of final consistency of message sending is perfectly solved.

The embodiment of the invention discloses a data interaction processing method, apparatus and system. The method includes the steps of a sending terminal sending a request message including business data and preset overtime processing time to a message middleware, the message middleware sending the request message to a receiving terminal, the receiving terminal determining whether the preset overtime processing time in the request message is late than the current time, if yes, the receiving terminal conducting corresponding business processing for the business data in the request message, the receiving terminal sending feedback message of the business processing result to the message middleware, the message middleware sending the feedback message to the sending terminal, and the sending terminal conducting corresponding business advancing processing based on the feedback message of the business data. The technical scheme provided in the embodiment can not only effectively ensure the final consistency of communication objects on business data interaction processing results, reduces the coupling degree between communication objects, and solves the problem of excessively large flow of business requests.

The embodiment of the invention discloses a service processing method, device and apparatus, a storage medium and a flow operation system. The method comprises the following steps: subscribing information of setting contents in a message queue, wherein the setting contents are specified by an associated service system, and messages in the message queue are updated by a flow system; calling a service serving interface according to the obtained information, and instructing the service system to execute a matching service task. The process system is used for managing business services provided byeach of the business systems, and the service system is used for providing business services. The embodiment of the invention can realize the final consistency of the data.

The embodiment of the invention discloses an information synchronization method, device and system, and the method comprises the steps: receiving an execution message, and determining a reconstructionidentification bit of an index corresponding to the execution message; if the reconstruction identification bit is being reconstructed, continuing to create an index, and caching the update message in a Redis queue; and completing the index creation, traversing the Redis queue, and calling the update message to realize the synchronization of the data in the Elasticsearch search engine and the data in the query database. According to the method disclosed by the embodiment of the invention, the update message is cached in the Redis queue, and after the index is reconstructed, the update messageis taken out from the cache and then consumed into the new index, so that the final consistency of the data in the Elasticsearch search search engine and the data in the query database is ensured.

The invention relates to a transaction data recording method and a transaction data playback method. The recording method comprises the following steps: a front-end system sends a transaction requestto an ESC cloud terminal, asynchronously writes the transaction request into a local kafka cluster, and synchronizes the transaction request to a remote data center through a MirorMaker mirror image;if the local transaction recording compensation application successfully receives the ACK message, verifying the transaction record according to the ACK message; the local ESC cloud terminal asynchronously writes a response message into the local kafka cluster after receiving the response of the back-end service system, and creates a top-to-end service system; the top-to-top is sent to the server,and the top-to-top is sent to the server. Persistence is carried out on the res message to a local database, and the top-value-is obtained through the MirorMaker mirror image. And the res message issynchronized to a remote data center. According to the transaction data recording method and the transaction data playback method, the data difference of asynchronous data synchronization is made up,and the final consistency of the data can be guaranteed when remote fault switching is carried out.

The invention provides a distributed transaction processing method, and belongs to the technical field of transaction processing. The method comprises the following steps of: splitting a distributed transaction into a plurality of sub-transactions; ensuring that the first sub-transaction is a local transaction; before the second sub-transaction is executed, publishing a message to message-oriented middleware; pushing the message to another node which participates in the transaction by the message-oriented middleware to ensure that the node executes the local transaction; and if the node fails to execute the local transaction, sending a message for executing the local transaction by the message-oriented middleware until the node successfully execute the local transaction, so as to achieve the final consistence of the data. In order to eliminate repeated messages, a message application state table is locally created to record the message execution condition, so that repeated execution is avoided and the idempotence of the operation is ensured.

The invention belongs to the technical field of block chains, and particularly relates to a data consistency maintenance method for realizing cross-chain interoperation. Aiming at a cross-chain business scene, the method comprises the following steps: designing a new cross-chain collaborative model, and realizing that interoperation can be completed on resources on multiple chains on the chain; designing a cross-chain consistency maintenance method for stable token and digital assets, wherein the method is used for ensuring the causality and final consistency of cross-chain interoperation in multiple chains; and designing a cross-chain consensus protocol based on a transaction mode and a random verifiable function to ensure the certainty of cross-chain operation. The invention is embedded into the block chain system in a plug-in manner in a service form, and has no invasion to the existing system. According to the invention, the cross-chain cooperation requirements among different cross-scene and cross-region block chain applications can be met.