218results about How to "Ensure data consistency" patented technology

The disclosed embodiments provide a system that archives data for a distributed filesystem. Two or more cloud controllers collectively manage distributed filesystem data that is stored in one or more cloud storage systems; the cloud controllers cache and ensure data consistency for the stored data. During operation, a cloud controller receives a request from a client for a data block of a file stored in the distributed filesystem. Upon determining that the requested data block is not currently cached in the cloud controller, the cloud controller sends a peer cache request for the requested data block to a peer cloud controller in the distributed filesystem.

The present invention is related to databases and the exchange of scientific information. Specifically the invention discloses a laboratory data management system including a knowledge base that stores characteristics of laboratory reagents, experiment subjects, tissues and cells. The invention also includes an experiment input module that accepts input of parameters of an experiment and data from a knowledge base module. Further, the invention includes a protocol creator connected to the knowledge base module and the experiment input module that creates a laboratory protocol for an experiment based on data supplied from the knowledge base module and the experiment input module. The invention also includes methods to use the described system.

A block chain-based distributed logistic tracking method is disclosed and comprises the following steps: an order is placed by a user via a conventional information system, the order is distributed to an order node, and order information is generated; upper node private key decryption verification is adopted for a warehouse node, package information is generated and stored in a block chain after successful verification, and packaging operation is conducted by a sorter; the package is picked up via a package pickup and sending node, the upper node private key decryption verification is adopted, package pickup information is generated and stored in the block chain after successful verification, an optimal transport route is calculated, the upper node private key decryption verification is adopted for a transport node, transport information is generated and stored in the block chain after successful verification, the upper node private key decryption verification is adopted for a package delivery node, package delivery information is generated and stored in the block chain after successful verification, an express delivery worker sends the package to the user who places the order, the upper node private key decryption verification is adopted by the user, and signing information is generated and stored in the block chain after successful verification. Via the block chain-based distributed logistic tracking method, encryption performance and safety of data flows can be greatly improved, the optimal route is provided, and whole course data can be monitored and traced.

The invention relates to an across-room multiple-active distributed database management system and an across-room multiple-active distributed database management method. The system comprises a database middleware session proxy cluster, a database storage instance cluster and a middleware bidirectional data synchronization control component cluster. The database middleware session proxy cluster is distributed in different rooms. The database storage instance cluster includes regional clusters arranged in corresponding rooms, and the regional clusters are connected with the database middleware session proxy cluster and the middleware bidirectional data synchronization control component cluster. The middleware bidirectional data synchronization control component cluster synchronizes the data information of the regional clusters in different rooms to ensure the data consistency of the regional clusters. If the database middleware session proxy cluster detects a downtime fault occurring to the regional cluster in the room corresponding to service session data after receiving the service session data input by a user, the service session data is read or written in the regional clusters of other rooms. Normal reading / writing of service session data is not affected by failure of a regional cluster, and the reliability of data reading / writing operation is improved.

The invention discloses a database access platform and access method, which solves problems of high requirements on technician, impalpable code and safety of traditional database operation mode. The platform mainly comprises an application access interface for supplying setting of database configuration information and feeding back database operation result; a data source acquisition unit for connecting corresponding database according to the database names in the configuration information; a database single table operation unit for calling corresponding table structure information according to the access parameters in the configuration information and executing corresponding SQL operation in combination with generation of SQL sentence; a database complex operation unit for calling corresponding SQL template according to the access parameter in the configuration information and executing corresponding SQL operation in combination with generation of SQL sentence. Because of shielding direct SQL operation, the platform facilitates developers unnecessary to concern detailed SQL sentence spelling and database operation and greatly reduces the technical requirements on developers.

Disclosed is a system for replicating data. The system may comprise a plurality of nodes preferably organised in groups with one of the nodes acting as a coordinator node. The nodes are configured to receive write requests from an external server and to apply these write requests to a data storage source of the data storage system. The write requests typically belong to a batch of independent write actions identified by a batch sequence number. Each node stores the write request in non-volatile memory with the coordinator node monitoring which batches are secured in their entirety in non-volatile memory. The coordinator node authorises all other nodes to sequentially replicate the write requests in their non-volatile memory to the data storage source for all writes up to the highest batch sequence number for which all writes have been secured in non-volatile memory.

In creating replicas to data of a storage volume in a storage system, a technique in which labor for issuing instructions from a processor can be reduced and then data consistency of related volumes can be secured is provided. A single replication instruction including designated information is issued for data of a logical unit serving as a copy source and a copy destination from a replication-control program of the processor. A control unit of the storage system possesses a multiple-replica creation program which enables a processing for creating replicas while securing the data consistency when an access such as a update or reference occurs for a group including a plurality of pairs of copy-source volume and copy-destination volume based on reception of the instruction. A save volume is provided to identify and control data save and update state by copy-source save information and copy-destination update information at the shared memory.

The invention provides a cloud storage data synchronizing framework based on analyzing the shortcoming of a single point failure of central server nodes Namenode, which exists in a hadoop distributed file system (HDFS) module in the current Hadoop framework. The cloud storage data synchronizing framework adopts a double-center-server architecture, and double center servers serve on line simultaneously, so that data consistency is realized; and a three-machine Paxos algorithm aiming at the double center servers and based on a distribution consistency Paxos algorithm is designed, so that a data synchronizing framework Quorum is formed, and read-write operation on the architecture is standardized. By the data synchronizing framework Quorum, the problem of service interruption under the condition of the signal point failure of the nodes Namenode is well solved, so that a system can provide correct data read-write access outward under the condition that a certain server fails, and final consistency of data can be ensured.

The invention provides a data migration method and a data migration device. The method comprises the steps of obtaining configuration information, wherein the configuration information contains a source database address and a target database address; connecting to a source database according to the source database address, connecting to a target database according to the target database address to build a migration channel corresponding to the configuration information; transmitting a data migration request to the source database through the migration channel; obtaining total data transmitted by the source database in response to the data migration request through the migration channel and transmitting the total data to the corresponding target database through the migration channel; extracting incremental data of the source database through the migration channel and introducing the incremental data into the corresponding target database through the migration channel according to the time sequence of data generation. According to the method, the convenience of migration operation of the data can be improved.

In creating replicas to data of a storage volume in a storage system, a technique in which labor for issuing instructions from a processor can be reduced and then data consistency of related volumes can be secured is provided. A single replication instruction including designated information is issued for data of a logical unit serving as a copy source and a copy destination from a replication-control program of the processor. A control unit of the storage system possesses a multiple-replica creation program which enables a processing for creating replicas while securing the data consistency when an access such as a update or reference occurs for a group including a plurality of pairs of copy-source volume and copy-destination volume based on reception of the instruction. A save volume is provided to identify and control data save and update state by copy-source save information and copy-destination update information at the shared memory.

The invention discloses a multi-copy storage method and a multi-copy storage system for a distributed database system, and belongs to the field of computer software. The multi-copy storage system comprises a main Master node, a standby Master node, a plurality of storage nodes and a connection network. The multi-copy storage method includes steps of 1, storing data in different data pieces; 2, only allowing a user to operate the data in a primary version, and enabling the multi-copy storage system to synchronize change of the data to various copies in real time and guarantee the atomicity; 3, enabling the multi-copy storage system to detect survival conditions of the nodes via synchronous heartbeat detection, and enabling a main Master host to instantly select an available copy to replace the primary version when a certain storage node of the data in the primary version dies; 4, enabling the multi-copy storage system to carry out detection and repair operation for the storage copies regularly, and migrating the data pieces with excessively low quantities of copies to other available storage nodes by means of local storage migration. A main storage model and a standby storage model are adopted for each data piece, and the copies are of completely identical logical structures and are distributed on different physical storage nodes. The multi-copy storage method and the multi-copy storage system have the advantages that the integrity and the availability of the data are protected against the death of optional nodes of the system.

The invention discloses a data management method and a system of an HBase database. The management method comprises the steps of writing response data into a request, generating HBase records to be stored in the HBase database; using fields with the content sizes larger preset field threshold values and included in the HBase records to be stored as large fields and extracting contents of the large fields to generate large field data blocks; writing the large field data blocks into container files stored in an HDFS file system; using positions of the large field data blocks in the HDFS file system as references and using the references to take the place of the contents of the large fields in the HBase records to be stored; storing the HBase records to be stored in the HBase. By adopting the data management method and the system of the HBase database, the advantages of an HBase and an HDFS can be well played, the large-field processing defect of the HBase is overcome, the shortcoming of overlarge resource consumption of the HDFS during small file storage is overcome, the business demand is met well, and good effect is obtained in the actual application.

The invention provides a collaborative management device and a collaborative management method for simulation resource information and model source codes, which are used for collaboratively managing a relational data base and a concurrent version system (CVS) version management base. The device comprises a data consistency access interface of an external data access interface, a data update synchronizing and monitoring module for monitoring and synchronizing update operations of the two resource bases in real time, a data integrity testing and backspacing module for regularly checking the integrity of the corresponding relationship between the data in the two resource bases, and a collaborative access log module for recording information of all synchronous visit operations. The method is characterized that a database table structure is firstly designed to realize structural storage of simulation resource information; the model management base is created; and a consistent data storage function and a synchronous data update function are fulfilled by utilizing the device. The device and the method ensure the consistency, the integrity and the safety of the data in the collaborative management process of the relational data base and the CVS.

The invention provides a step-by-step database data distribution uploading and synchronizing method. A step-by-step database system consists of a center database and a plurality of station databases. The step-by-step database data synchronizing method comprises the following steps: data distribution processing and data uploading processing, wherein in the step of the data distribution processing, business data are exported from the center database and imported into the station databases; and in the step of the data uploading processing, the business data are exported from the station databases and imported into the center database.

The invention discloses an electronic bill identifier distribution method, an electronic bill generation method, device and system. The method is applied to a distributed system; the distributed system comprises a processing node, the method is executed by one processing node in the distributed system, and the method comprises: enabling the processing node to receive an electronic bill identification application request initiated by a service node; Generating an electronic bill identifier set according to the electronic bill issuing number in response to the electronic bill identifier application request; In the distributed system, synchronizing the electronic bill identifiers in the electronic bill identifier set; And after the electronic bill identifiers in the electronic bill identifierset are synchronized in the distributed system, distributing the electronic bill identifiers in the electronic bill identifier set to the service node. By adopting the method and the device, the problem of poor universality of the electronic bill identifier distributed based on the distributed system in the prior art is solved.

The invention relates to a cache processing method and system of a distributed database. The system comprises a receiving module, an order matching module, an analyzing module, a judging module, a cache analyzing module, a table name judging module, a routing module and a feedback module. The receiving module is in one-way connection with the analyzing module and the order matching module. The order matching module is in one-way connection with a client side and the analyzing module. The analyzing module is in one-way connection with the judging module. The judging module is in one-way connection with the cache analyzing module and the routing module. The cache analyzing module is connected with the feedback module through the table name judging module. The routing module sends a buffering result to the feedback module. The feedback module returns the buffering result to the client side. According to the cache processing method and system, the system concurrent processing capacity and the system resource utilization ratio are improved, a load on a low-end server is utilized for sharing the storage space of the database to process data, and performance and safety are improved.

A method and system for integrated modality worklists management for hybrid scanners is disclosed. The present invention retrieves schedules of multiple modalities in a hybrid scanner in response to a single action by the operator of the hybrid scanner, thereby improving operator efficiency. The retrieved schedules are collated and stored in a common database. The automated maintenance of a common database improves data integrity.

The invention discloses a method for data migration of a non-relational database HBase. According to the method, by reading configuration file information of users, data within a time period designated by the users are migrated from an old HBase cluster to a new HBase cluster. The method has the advantages that by designing RowKey, group information and time information of the data are embodied on the RowKey, and whether the data corresponding to the RowKey are within a migration time range designated by the users can be directly identified by scanning the RowKey during data migration; groups serve as data migration units, every group serves as a check point, the range of the non-synchronous data between the old HBase cluster and the new HBase cluster can be rigidly controlled within one group when abnormal conditions occur, and time required for restoring data synchronization is reduced; log information is recorded in the data migration process to be used for treating the abnormal conditions in the data migration process, synchronization of the data between the old cluster and the new cluster is guaranteed, and data migration between the HBase clusters can be finished accurately and efficiently.

The embodiment of the invention provides a primary / backup switching method and device of a database. The method comprises the following steps: monitoring the operation of a first database which serves as a current primary database, and sending a backup-to-primary request to a second database which serves as a current backup database when a the operation exception of the first database is detected; obtaining feedback data reported when he second database is successfully switched to a current primary database since the second database detects that data in the first database and the second database is consistent, and obtaining data switching information which is finally synchronized from the first database by the second database according to the feedback data; and sending a primary-to-backup request which contains the data switching information to the first database to cause the first database to judge that the data synchronized to the second database is not subjected to data loss according to the data switching information, and switching to the current backup database.

In creating replicas to data of a storage volume in a storage system, a technique in which labor for issuing instructions from a processor can be reduced and then data consistency of related volumes can be secured is provided. A single replication instruction including designated information is issued for data of a logical unit serving as a copy source and a copy destination from a replication-control program of the processor. A control unit of the storage system possesses a multiple-replica creation program which enables a processing for creating replicas while securing the data consistency when an access such as a update or reference occurs for a group including a plurality of pairs of copy-source volume and copy-destination volume based on reception of the instruction. A save volume is provided to identify and control data save and update state by copy-source save information and copy-destination update information at the shared memory.

The invention discloses a multi-business user data managing system based on a mixed database and a method for the same. The multi-business user data managing system comprises a system inlet / outlet module for importing and exporting user data, a distributed processing module having a data classifying module, a data screening recording module, a data integrating module and a data checking module, and a data storage cluster comprising a relational database, a Hadoop cluster and a MongoDB cluster. Data is classified and stored via a method of combing a traditional relational database and a non-relational database; the mixed database storage model has advantages of strong versatility and data consistency of the relational database during structural data processing and possesses characteristics of great reading-writing capacity and high framework module extendibility of the non-relational database during the process of the great number of non-structural data.

The invention discloses a database migration method and device and a storage medium which are used for reducing the impact on the normal access operation of a database during a database migration process. The database migration method includes a step of acquiring first location information of database operation log data, a step of buffering log change data for a source database operation, a step of querying a database table to be migrated from the source database for the database table to be migrated and resetting the database table to be migrated in the target database, and a step of resetting the log change data in the target database according to cached log change data until second location information corresponding to the reset log change data is not smaller than the first location information.

The present invention relates to a method for ensuring data consistency upon mapping of a hierarchical data format to a relational database management system.According to the invention, a method for ensuring data consistency upon storage of a data item in a database, the data item having an identifier and a locator for linking the data item to a destination, whereby the identifier and the locator are stored in the database in addition to the data item, comprises the steps of:checking (11) whether the current combination of identifier and locator has already been stored in the database, and using (12) the stored combination of the data item if this is the case,in case the current combination of identifier and locator has not yet been stored in the database, checking (13, 15) whether either the identifier or the locator has already been stored in the database, replacing (14, 16) the current combination of identifier and locator with a univocal combination if this is the case, and storing (17) the univocal combination together with the data item, andstoring (17) the current combination of identifier and locator together with the data item else.

The invention relates to a high-availability virtual machine pooling management system based on roles. According to the virtual machine pooling management method, a master node, a slave node and a backup node are included. The master node is the only logic entrance of a virtual machine resource pool and responsible for managing all nodes in the resource pool. The slave node is mainly responsible for managing a life cycle of a virtual machine of the slave node. The backup node is used for backing up state information of the master node, ensuring consistency with the state information of the master node, and taking over the work of the master node when the master node fails. During a virtual machine pooling management process, all the nodes can switch over three roles along with different conditions, wherein the three roles are the master node, the slave node and the backup node. A serial method is used for ensuring that only one master node and one backup node exist in the system and a double-direction asynchronous communication mechanism is used for ensuring consistency of data of the master node and the backup node. The high-availability virtual machine pooling management system based on the roles improves reliability of a virtualized system and flexibility of management.

The embodiment of the invention provides a consensus method of a block chain system and related equipment. The block chain system comprises a block chain and a consensus committee, the consensus committee comprises a plurality of node devices participating in consensus. The method is executed by first node equipment, the first node equipment is any node equipment in the consensus committee, and the method comprises the steps that in the Nth round of consensus process of the block height H of a block chain, whether a block in a locked state exists in a cache space or not is checked, and H and Nare both positive integers; if the block in the locked state exists in the cache space, the block in the locked state is determined as a target block to be consensus; and consensus processing is performed on the target block to obtain a consensus result of the target block in the Nth round of consensus process of the block height H of the block chain. The embodiment of the invention can ensure consensus accuracy.

The invention provides a method and a device for executing multiple tasks, electronic equipment and a computer readable medium, being capable of reducing the workload of repeated development of a developer, and ensuring data consistency during interaction between multiple systems, without affecting the performance of the whole system at the same time. The method for executing the multiple tasks provided by the invention comprises the steps of receiving task data sent by each service system, wherein each piece of task data comprises a respective task type that is corresponding to a service logic for executing the task, and the service logic is stored in a server; according to a preset task distribution rule, distributing each task to the preset quantity of task queues; and generating a taskexecuter for each task of the task queues according to a corresponding task type and executing the corresponding task by the task executer according to a preset task execution rule, wherein the taskexecuter is used for executing the service logic corresponding to the server.

The invention provides a method for improving data transmission efficiency on the basis of TCP (Transmission Control Protocol) long connection. Data communication is carried out between a client and a server by adopting TCP long connection; the receiving and processing of the client and the server are subjected to parallel processing by adopting an asynchronous mode; a communication data packet adopts a numbering mechanism to ensure the data reliability and the processing consistency; the communication reliability is ensured by a heartbeat detection and failure reconnection mechanism; the parallel transmission efficiency is improved by using a connection pool; and the client and the server process a plurality of queues and a plurality of threads, the parallelism of data processing is improved and the processing efficiency is improved.

The invention provides a method of updating caching data at a client end in a distributed system, which includes: when data processing operation on a server is invoked remotely and successively executed, the operation mark information and the related object type thereof are placed in a first set; a write operation set is identified from the first set and the related object type is placed in the server context of all login users at regular intervals; polling request of the client end is received and the corresponding object type is returned from the server content; the client end empties the data related with the object type in cache; and perform partition management to the caching data of client end according to the object type. In the invention, the server monitors the write method, the client end initiates the polling and performs the partition management to the caching data of the client end. The cooperation work of the measures can guarantee the data consistency of all online client ends connected with the same server.

A bladed storage servicing system comprising a RAID layout facilitates the removal of one or more functional storage devices in a tray of the bladed storage subsystem in order to service a failed storage device. Upon removal of the tray from the bladed storage subsystem, the system designates the functional storage devices on the tray as temporarily removed. The system logs writes to the removed functional storage devices so that the functional storage devices can be returned to consistency when replaced in the bladed storage subsystem. The system manages reads to the removed functional storage devices through reconstruction from active storage devices in the bladed storage subsystem. Upon reinsertion of the tray in the bladed storage subsystem, the system verifies the identities of the functional storage devices and resynchronizes the functional storage devices to ensure data consistency.