70results about How to "Improve data synchronization efficiency" patented technology

This invention discloses a method for synchronizing a plurality of devices, including: obtaining, by a first device, an extended address of an informational node of a plurality of informational nodes of a second device, the plurality of informational nodes arranged in a hierarchical tree structure; and utilizing the extended address to locate the informational node amongst the tree structure to enable synchronization of the informational node; wherein the extended address includes a hierarchical location of the informational node. This invention further discloses a system, client and server for data sync, and the folder-level data sync can be implemented by using the method of this invention.

The invention relates to the technical field of block chains, in particular to a block chain storage method and device based on data compression, equipment and a storage medium. The method comprises the following steps: obtaining transaction data and corresponding transaction keywords, and compressing the transaction data to obtain compressed data; Generating a data block together with the compressed data and the transaction keyword, and linking the data block in a block chain network; Broadcasting the linked data blocks to other nodes in the block chain network; and receiving other data blocks broadcasted by other nodes in the block chain network, and synchronizing the other data blocks to own nodes. The compression technology is applied to the block chain storage, before the transactiondata is generated into the block, the transaction data is compressed to generate the block, and the block is linked, so that the expansion rate of the data is greatly reduced, and the storage cost isreduced.

The embodiment of the invention relates to the technical field of databases, in particular to a database synchronization method and a database synchronization device, which are used for improving the initialization efficiency in a data synchronization process of a target database. According to the database synchronization method and the database synchronization device, a total data request message is sent to a source snapshotting server by a target server, determined total data information is sent to the target server by the source snapshotting server, so that a total data snapshotting document is obtained by the target server according to the total data information, and the total data snapshotting document is led into the target database, and thus, the initialization process of the target database is finished, thereby realizing automatic initialization control in the data synchronization process of the target database and improving the initialization efficiency in the data synchronization process of the target database.

The invention relates to the field of data processing, achieves data synchronization between databases, and particularly provides a data synchronization method and device, equipment and a storage medium. The method comprises the steps of obtaining a log operation file of a source database and a database type corresponding to the source database; determining a file analysis rule corresponding to the database type of the source database according to a preset corresponding relation between the database type and the file analysis rule; analyzing the log operation file according to the determined file analysis rule to obtain an analysis file; obtaining a database type of a target database, and generating an SQL file according to the database type of the target database and the analysis file; and uploading the SQL file to a cloud server to enable the cloud server to send the SQL file to the target database for execution so as to complete data synchronization. According to the method, data synchronization between different databases can be achieved, and meanwhile the data synchronization efficiency is improved.

The invention discloses a method for distributing data and a data synchronization system. The method in an embodiment of the invention includes acquiring synchronous data in a source database subsystem by the aid of a data synchronization file generating subsystem and generating SQL (structured query language) data files according to the synchronous data; acquiring the SQL data files from the data synchronization file generating subsystem by the aid of an internal network and transmitting the SQL data files to an external network; receiving the SQL data files by the aid of the external network and verifying the received SQL data files so as to determine whether the received SQL data files are consistent with the SQL data files transmitted by the internal network; synchronizing the synchronous data in the SQL data files to a target database subsystem by the aid of the external network if the received SQL data files are consistent with the SQL data files transmitted by the internal network; or generating first prompting information by the aid of the external network if the received SQL data files are not consistent with the SQL data files transmitted by the internal network. The first prompting information is used for indicating that the SQL data files received by the external network are not consistent with the SQL data files transmitted by the internal network. The method and the data synchronization system have the advantages that the data synchronization and integration efficiency of the data synchronization system can be improved, operation and maintenance pressures can be relieved, and the consistency of the synchronous data can be guaranteed.

The invention discloses a data synchronization method and device, electronic equipment and a computer readable storage medium. The method comprises the following steps: receiving change data transmitted by a message queue, wherein the change data comprises changed data in a source database; determining first change data meeting preset conditions in the change data, wherein the preset conditions include that data operation types corresponding to the change data are the same, and data tables, to be synchronized into a target database, of the change data are the same; and submitting the first change data to the target database at the same time.

The invention discloses a blockchain node data synchronization method and device and a storage medium, and is applied to the technical field of data processing. The method provided by the invention comprises the steps of obtaining a real-time state of a blockchain, and judging a local state based on the real-time state; if the judgment result is that the local state is inconsistent with the real-time state, initiating a state synchronization request to the named data network; receiving a world state tree root of a blockchain fed back by the named data network based on the state synchronization request, and initiating a state tree reconstruction request to the named data network based on the world state tree root; receiving to-be-synchronized state data fed back by the named data network based on the state tree reconstruction request, and performing data synchronization on a local state according to a preset rule. The method and the device are used for improving the data synchronization efficiency of the blockchain node.

A data synchronization method, device and server of a database system, the data synchronization method of the database system comprising: reading a transaction scope consisting of logical change records (LCRs) of a source database; distributing the LCRs corresponding to the same data sheet of the transaction scope to the same thread of multiple threads, the multiple threads being configured to execute the LCRs, such that data synchronization tasks of some or all of different data sheets can be processed concurrently, thus improving data synchronization efficiency of the database system.

The invention relates to the field of data processing, realizes data synchronization between cloud storage, and particularly provides a data synchronization method and device, equipment and a storagemedium. The method comprises the steps of obtaining a file identifier corresponding to a data file needing to be downloaded by a user; downloading the data file from a target cloud according to the file identifier, and monitoring whether the data file is downloaded successfully or not; if downloading of the data file fails, acquiring configuration information of the user for the target cloud,wherein the configuration information comprises a storage path and a reading parameter corresponding to a historical cloud for storing the data file; downloading the data file according to the reading parameters and the storage path, and sending the data file to a user; and after the data file is successfully sent, migrating the data file to the target cloud. According to the data synchronization method, data synchronization time is shortened and data synchronization efficiency is improved.

The invention discloses a data updating system based on httpclient and a method thereof. A client, a server and an FTP server are included. The client is provided with a configuration module, a service module and a local database. The server is provided with an identity authentication module, a data processing module and a cloud database. The configuration module is used for configuring connection information and executing connectivity testing for the server and the local database. The service module is used to request a service from the server, download data from the FTP server, and carry out data synchronization on the local database. The identity authentication module is used for responding to the connectivity testing of the client, executing identity verification and responding to a client identity authentication request. Through the above mode, by using the data updating system based on httpclient and the method thereof, automation data updating is rapidly realized, an updating process is safe, reliable and high-efficient, and data synchronization efficiency of the client and the server is greatly increased.

The invention discloses a data synchronization method, a device and a computer storage medium. The method comprises the steps of: after the data information is changed, generating a synchronization message corresponding to the data information; Sending the synchronization message to a message queue listened to by the second system. The method comprises the following steps of: monitoring a messagequeue on a first system side; Acquiring a synchronization message in the message queue; Performing de-reprocessing on the obtained synchronization message corresponding to the same data information; Acquiring data information corresponding to the synchronization message after the reprocessing from the first system, and executing a data synchronization operation. The data synchronization mode of the invention is simple and easy to operate, and the data synchronization efficiency can be effectively improved. Especially in the process of maintaining mass data, the data synchronization can be quickly completed according to the data information change in batch.

The invention provides a method and a terminal for synchronizing data between nodes in a block chain. The method comprises the following steps: broadcasting a block chain update message to a block chain network; receiving a request synchronization message sent by the node receiving the block chain update message in the block chain network according to the block chain update message, wherein the request synchronization message comprises broadband capability information corresponding to the node sending the request synchronization message; and synchronizing data matched with the broadband capability information to a corresponding node. A data synchronization mechanism based on the real-time network transmission capability of the block chain node is realized; the data synchronization efficiency between the nodes in the block chain network is improved, meanwhile, due to the unpredictability and unfixity of the bandwidth capacity of each node in the block chain network, the node for data synchronization and the unpredictability of the data updated by each node are decided, and the data safety and the fairness between the nodes are also ensured.

The embodiment of the invention provides a data synchronizing method, device and system, which are applied to video of things. The video of things comprises a co-forwarding server, a monitoring dispatching platform and a monitoring device. The method comprises the following steps: the monitoring dispatching platform obtains video-of-things address information of the co-forwarding server; accordingto the video-of-things address information of the co-forwarding server, a monitoring device resource request is sent to the co-forwarding server; the co-forwarding server reads resource data of the monitoring device and carries out sub-package processing on the resource data of the monitoring device; the sub-packaged resource data of the monitoring device is sent to the monitoring dispatching platform; the monitoring dispatching platform verifies the sub-packaged resource data of the monitoring device; if the verification is passed, the sub-packaged resource data of the monitoring device is stored, thereby solving the problem that in the prior art, the configuration information of the monitoring dispatching platform can only be modified manually, the workload is large and error recordingis easy to occur, thereby reducing human intervention in the synchronization process, and accelerating the data synchronization efficiency.

The invention discloses a data synchronization method and device, computer equipment and a computer storage medium, relates to the technical field of cloud storage, and aims to reduce the bandwidth pressure of each paged data table in the data synchronization process and improve the data synchronization efficiency. The method comprises the following steps: acquiring paging data configured by a service party; compressing the paging data into a data table according to a preset compression format to obtain a to-be-synchronized data table in a paging compressed file format; synchronizing the to-be-synchronized data table to a target database of a server in a multi-thread paging compressed file format according to a preset synchronous scheduling task, decompressing the synchronous data table bythe server according to a preset decompression format, obtaining each paging data in the synchronous data table, and writing each paging data thread in the synchronous data table into a target database in a command loading manner.

The invention discloses a block chain data processing method and device, equipment and a storage medium. The method can be executed by a blockchain node, and comprises the following steps: respondingto a blockchain branch request sent by a proof node in a blockchain network, the blockchain branch request being generated when the proof node detects that a current blockchain satisfies a branch condition; according to a chaining rule, performing child-mother chaining on the current block chain, and storing the chained mother chain in the proving node; and processing the data of each block in themother chain, constructing a provenance block of a sub-block chain according to a processing result, and taking the sub-block chain as a new current block chain. The data storage space of the block chain network can be reduced, so that the data synchronization and data query efficiency of each node is improved.

The invention discloses a method for K-DB database data synchronization. The K-DB database data synchronization method comprises the following steps: a source end database maps the changed target datato a redo log; the target redo log corresponding to the target data is extracted; the target redo log is sent to target end database, the target end database obtains the target data according to thetarget redo log and synchronizes the target data to the second data table. According to the technical scheme provided by the method for K-DB database data synchronization, the version and the machineconfiguration of the source end database and the target end database are not limited, the third-party synchronization software is not needed, only the changed target data is needed, and the memory space of the target end database is saved, and the data synchronization efficiency is improved. The invention also discloses a K-DB database data synchronization device, a system and a storage medium, and has the corresponding technical effect.

The invention discloses a multiple-control and multiple-activity RAID synchronization method and system. The method comprises the steps that main target RAID nodes receive lock request of a target RAID; the main target RAID nodes utilize the lock request to search for target strips and determines whether or not the target strips are occupied; if not, the main target RAID nodes send authorization information to the target RAID; the target RAID locks the target strips to facilitate data synchronization among RAID, wherein each main target RAID node includes RAID with the same ID as the target RAID and is any one of K main target RAID nodes, and the main target RAID nodes are responsible for lock requests of RAID with different IDs. According to the multiple-control and multiple-activity RAID synchronization method and system, by distributing different main target RAID nodes in different RAID nodes, the lock requests of RAID with different IDs can be dispersed on multiple RAID nodes; the communication for the lock request is conducted between the target RAID and the main target RAID nodes, so that the situation is avoided that a large number of lock requests are produced, the consistency of RAID data is ensured, and the efficiency of IO is guaranteed.

The invention relates to a fast data synchronization method in continuous data protection technology. The method is technically characterized by including the steps of firstly, establishing correspondence between all data blocks in disk partitions and a write operation status bitmap in a production terminal device; secondly, synchronizing for the first time, namely copying all the data blocks in the disk partitions in the production terminal device to an image storage region in a target terminal; thirdly, performing progressive synchronization, namely calculating the number of the data blocks, engaged in write operation, in the disk partitions during synchronization; if the changing number is lower than a set threshold, interrupting front-end application of the production terminal device to quickly complete synchronization of the changing data blocks; and if not, copying the data blocks, engaged in write operation, to the target terminal. The data blocks which change in data synchronization are recorded by the write operation status bitmap, the changing data blocks are determined according to the bitmap so as to achieve quick data synchronization, and accordingly data synchronization efficiency is improved. The method has the advantages of high timeliness, fast processing, safety and reliability and the like.

The invention discloses a data processing method, a server, a system and a storage medium. The method comprises the steps that in the process that a game application client runs a game task, a data processing request sent by the game application client is acquired; responding to the data processing request, and obtaining attribution data of each virtual city pool and position information of each virtual city pool which are currently set in the game task; determining a target city pool associated with the first account according to the attribution data of each virtual city pool and the positioninformation of each virtual city pool, the target city pool being in a contention state; According to the competition result of the target city pool, updating the attribution data of the target citypool, and updating the first attribution data associated with the first account. According to the invention, the problem of low data synchronization efficiency is solved.

The invention relates to the technical field of methods for determining coverage ranges of base stations in mobile communication optimization analysis systems, in particular to a mobile communication cell simulation coverage drawing method. A base station coverage layer is generated through a base station point layer, the base station coverage layer is cut through a pre-generated cutting surface, and therefore the cell coverage layer is obtained. Through the mobile communication cell simulation coverage drawing method, a cell simulation coverage area can be generated rapidly, updating in the area range is conducted through cut-over data, and data synchronization efficiency is improved.

The invention discloses a configuration synchronization method of a cluster file system. The cluster file system comprises a plurality of nodes, each node is provided with a mounting directory corresponding to the node, a memory file system and a gluster volume associated with each memory file system, the mounting directory is formed by mounting the gluster volume to a directory of the corresponding node, and the type of the gluster volume is a copy type. The method comprises the following steps of receiving the to-be-synchronized configuration information written into the mounting directory of the own node by the current node, and copying the to-be-synchronized configuration information to the mounting directories of other nodes through the gluster volume, so that the other nodes read theto-be-synchronized configuration information from the respective mounting directories and synchronize the configuration information, and the data synchronization efficiency of the cluster file systemcan be improved during the use process. The configuration synchronization device and system of the cluster file system and the computer readable storage medium provided by the invention have the sameabove beneficial effects.

The invention relates to a power grid monitoring system memory bank relation library synchronization method and device based on feature marking, computer equipment and a storage medium. The method comprises the steps that newly-added data is written into a data cache region of a memory database and marked; writing the newly added data with the mark into a cache file of a relational database according to a mapping relationship between the data cache region and the cache file of the relational database; and writing the newly added data temporarily stored in the cache file into the relational database according to the mark. According to the method, the newly-added data is marked, and the newly-added data temporarily stored in the cache file is written into the relational database, so that the problem that the memory database needs to synchronize the data after a period of time is solved. The system data can be synchronized quickly; the efficiency of data synchronization between the memory banks and the relation banks of the power grid monitoring system based on the feature marks is improved.

The invention discloses a method and a system for carrying out real-time data synchronization based on rsync. The method comprises the following steps: carrying out the real-time monitoring of a filesystem, and obtaining monitoring data; setting the data synchronization frequency of the file system according to the acquired command; judging whether the size of the current file system is smaller than or equal to a set file system threshold value or not according to the data synchronization frequency; and if so, executing a full-amount synchronization mode, otherwise, executing an incremental synchronization mode. The system comprises a monitoring module, a frequency setting module, a judgment module, a total synchronization module and an increment synchronization module. Through application of the method and the device, the resource occupation of the server can be effectively reduced while the timely synchronization from the server to the client is ensured, the bandwidth is prevented from being influenced, and the overall performance of the server is improved.

The invention relates to a blockchain technology, and provides a data processing method based on a blockchain, which comprises the steps of creating an initial trade financing blockchain between an enterprise and a bank; receiving a data isolation request; according to the data isolation request, calling a corresponding data isolation rule to perform data isolation on the enterprise node to obtaina target trade financing blockchain; newly establishing an application store in the target trade financing blockchain, and receiving preset asset information pushed by the enterprise node through theapplication store; calling a risk control model on the bank node to screen preset asset information in the application store to obtain target asset information; and sending the target asset information to the bank node. Wherein the data and the information can be stored in the blockchain node. According to the method, the data processing efficiency of the blockchain can be improved.

The invention discloses a data synchronization method under a hybrid cloud architecture, which comprises the following steps: dividing data into a plurality of groups in a main cloud data center, allocating corresponding identifiers and version numbers to the data of each group, and sending the data, the identifiers and the version numbers to a client for storage; enabling the client to send the stored identifier to the main cloud data center at preset time intervals, and receive a version number returned by the main cloud data center; sequentially judging whether the version number returned by each group is the same as the version number in the client or not; and in response to the fact that the returned version number is different from the version number in the client, updating the dataand the version number of the group in the client. The invention further discloses computer equipment and a readable storage medium. According to the data synchronization method under the hybrid cloudarchitecture, equipment and the medium provided by the invention, by grouping and comparing the data, only a small amount of updated data can be backed up and restored, so that the data synchronization efficiency is greatly improved.