77results about How to "Improve synchronization efficiency" patented technology

The invention provides an OracIeRAC-based CDC synchronization method and system, and relates to the technical field of OracleRAC, and the method comprises the steps: deploying an incremental log analyzer, a session state collector and a resource monitor, and respectively collecting atomic operation, concurrent transaction information and node performance indexes; and identifying data stream features by using an intelligent classification model, constructing a priority matrix, and performing fine-grained acquisition on high-priority data based on an adaptive sampling strategy. According to the method, multi-dimensional evaluation indexes are further utilized, a time sequence prediction model is constructed to predict node loads, data synchronization tasks are distributed to low-load nodes based on a load balancing matrix, and a two-stage submission protocol is adopted to ensure data consistency. By monitoring the synchronization state in real time and dynamically adjusting the allocation strategy, the CDC synchronization efficiency and stability in the Oracle RAC environment are effectively improved, and the synchronization delay is reduced.

The invention discloses a self-adaptive data caching and synchronizing method, system and device for an edge gateway of the Internet of Things and a storage medium, and the method comprises the steps: obtaining network quality parameters, such as link bandwidth, time delay and packet loss rate, between nodes, detecting and solving instruction conflicts based on a vector clock mechanism, generating an instruction execution sequence, and carrying out the self-adaptive data caching and synchronizing of the edge gateway of the Internet of Things; local caching and incremental synchronization strategies are adopted for hotspot data, a data access mode is dynamically predicted in combination with a machine learning algorithm, and a cache updating period is optimized. The future data is predicted according to the data characteristics of the Internet of Things application, and the data cache updating period of each node is dynamically adjusted, so that each node can keep a relatively consistent updating rhythm when caching a hotspot data copy; therefore, the hot spot data copies of different nodes can be ensured to have similar accuracy and timeliness at the same time point, so that the data consistency is maintained.

The invention belongs to the technical field of data synchronization, and particularly relates to a real-time data synchronization method for cloud computing heterogeneous resources. In order to solve the problem of data synchronization among heterogeneous resources, the method comprises the following steps: aggregating a plurality of files in batches to generate a packaged file; performing metadata compression processing on the generated packaged file, and eliminating repeated data through a deduplication algorithm; dynamically selecting a lightweight data transmission protocol; establishing a multi-dimensional index structure; only retaining the file of the latest version through a version control mechanism; dynamically adjusting the allocation of synchronization tasks based on the load condition of available resources in the cloud computing environment; and rescheduling the uncompleted synchronization task. Through a multi-dimensional index structure, version control, self-adaptive transmission scheduling and a dynamic resource allocation mechanism, efficient and stable file synchronization among heterogeneous resources is realized, repeated transmission and storage waste are reduced, and real-time performance, reliability and resource utilization efficiency of synchronization are improved.

The invention relates to the technical field of big data and the field of financial science and technology, and discloses a database table synchronization method based on log data, which comprises the following steps: recording operation information of a business database table to log data, writing the log data into a message queue, obtaining the log data through a streaming data processing framework, and deserializing the log data into structured data; and extracting operation records, classifying the operation records according to operation type fields, distributing the operation records to processing channels corresponding to the table names, and updating or adjusting the table structure of the target table according to classification, or executing data change operation. Through the log data-based synchronization method, quasi-real-time synchronization from the business database table to the operation data storage module is realized, and the table structure is adaptively adjusted when the business table structure is changed, so that the data consistency problem and the system interruption risk are reduced, the data synchronization efficiency and stability are effectively improved, and the user experience is improved. And the efficient and stable data synchronization requirements of the service are met.

The invention relates to the technical field of data processing, in particular to a financial data synchronization method and system, computer equipment and a storage medium, and the method comprises the following steps: based on input financial data, performing formatting and data cleaning, preprocessing the data, analyzing fund flow data, and performing consistency verification on the fund data; inconsistent data are identified and recorded, and a consistency verification result is generated. According to the method, by analyzing the data and extracting the incremental data needing to be synchronized, the synchronization efficiency is improved, real-time updating of the data is ensured, prediction of synchronization task time is carried out in combination with calculation resource requirements and real-time system loads, the synchronization priority is calculated, the reasonability of resource use is improved, the synchronized data is comprehensively verified, and the synchronization efficiency is improved. Data missing, repetition and inconsistency are found and corrected in time, the accuracy and consistency of financial data are ensured, the efficiency of financial data synchronization is improved, accurate and timely transmission and updating of the data are ensured, and the financial management process is optimized.

The invention discloses a data merging optimization method and device for incremental data migration, equipment and a storage medium, and relates to the technical field of databases, and the method comprises the steps: carrying out the data collection of a source end database, and sequentially sending the collected data to a message queue; sequentially pulling the data from the message queue, merging the data, and converting the data into a data packet; performing execution sequence number distribution on the data packets; and based on the execution sequence number, sequentially playing back the data of the data packet to a target end database. According to the method, the effect of concurrent execution of the single-table data is achieved through data merging, the problem that the single-table incremental data cannot be executed in parallel due to the time sequence problem is solved, the method does not depend on the characteristics of the database, can be suitable for data migration synchronization of different database types, and is good in compatibility.

The invention relates to a multichannel PCM data real-time acquisition and output system and method based on an ALSA framework, and the system comprises a multichannel analog quantity input unit and a multichannel analog quantity output unit, and also comprises a system configuration unit, a memory resource unit, an AD acquisition conversion unit, an audio routing unit, a DA output conversion unit and an ALSA DMA cache region distribution unit. The ALSA DMA cache region allocation unit is used for building a PCM data path of a user space and a kernel space and providing an annular cache region queue for storing DMA resource descriptors, and the audio routing unit obtains the returned DMA resource descriptors from the ALSA DMA cache region allocation unit and allocates the DMA resource descriptors to an output end to complete synchronous multichannel input and output of PCM data. According to the system provided by the invention, the ALSA DMA buffer area distribution unit is adopted, so that the DMA configuration process is simplified, and the data transmission efficiency is improved.

The invention belongs to the field of big data, and relates to a data synchronization method, comprising: acquiring a target timestamp recorded in a configuration table of a data management framework, the target timestamp being a maximum timestamp recorded in the configuration table when data synchronization processing is performed last time; the target timestamp is adopted as a screening condition, and incremental data with the timestamp larger than the target timestamp is inquired from the data source table; according to a field mapping relationship in the configuration table, determining a synchronization field which needs to be synchronized to the target table from the incremental data of the data source table; and on the basis of a preset unique field, matching the synchronization field of the data source table with the data of the target table, and on the basis of a matching result, synchronizing the synchronization field of the data source table to the target table. The invention further provides a device, equipment and a medium. In addition, the invention also relates to a block chain technology, and the configuration table of the data management framework, the target timestamp and the synchronization field of the data source table can be stored in the block chain. The incremental data synchronization efficiency can be improved.

The invention discloses a ship-shore data out-of-order synchronization method and device, electronic equipment and a storage medium, and the method comprises the steps: sending the compression information of a to-be-synchronized compression package to a shore end through a data synchronization request sent to the shore end, so as to enable the shore end to carry out the data synchronization detection based on the compression information, and obtaining a full bitmap of the data synchronization condition of the shore end; performing breakpoint detection on the data blocks based on the total bitmap to obtain breakpoint data; when the number of the breakpoint data is greater than the first number, retransmitting the breakpoint data to the shore end; otherwise, synchronizing the data blocks after the target block to the shore end in sequence; periodically acquiring a block receiving condition of a shore end, and updating the total bitmap based on the block receiving condition; and returning to execute the step of carrying out breakpoint detection on the data blocks based on the total bitmap to obtain breakpoint data, and carrying out a new round of data synchronization iteration until all the data blocks of the compressed packet are synchronized. The method can efficiently realize ship-shore data synchronization, and can be widely applied to the technical field of data processing.

The invention relates to the technical field of Bluetooth sound boxes, in particular to a Bluetooth sound box synchronous playing method and system. The method comprises the following steps: performing master device election on a Bluetooth loudspeaker box group to obtain a loudspeaker box group master device identifier; carrying out distributed time synchronization network construction on the Bluetooth sound box group based on the sound box group main equipment identifier to obtain a sound box group time synchronization network; performing environment signal scanning on the Bluetooth sound box group to obtain environment frequency band signal data; performing dynamic frequency band allocation on the Bluetooth loudspeaker box group based on the environment frequency band signal data to obtain a loudspeaker box group frequency band allocation scheme; performing network performance parameter monitoring on the Bluetooth sound box group to obtain a sound box group network performance parameter set; and according to the sound box group network performance parameter set, performing audio buffer area determination on the Bluetooth sound box group to obtain an audio buffer area distribution scheme. According to the invention, the accuracy and stability of audio synchronization are improved, the user experience is optimized, and the application scene of the Bluetooth sound box is widened.

This invention discloses a data synchronization method and system based on front-end orchestration management, belonging to the field of data synchronization. The method includes the following steps: selecting the data table and field information to be monitored through the front-end interface, generating configuration information, and orchestrating the synchronization process logic according to business needs; storing the configuration information in real time to the configuration center to generate real-time monitoring rules; capturing changed data of the data table and field information, encapsulating it into standard data units and sending it to a message queue; preprocessing the standard data units in the message queue; the synchronization adaptation module matching the corresponding driver type according to the synchronization process logic to generate a synchronization instruction set, and executing data synchronization operations based on the preprocessing results; performing full-link monitoring of the synchronization process, and performing task lifecycle management based on the lifecycle rules configured on the front end. This invention improves synchronization efficiency through dynamic threshold verification, multi-source field fusion weighting, and dynamic encryption strategies, and the full-link monitoring further enhances front-end manageability.

The present application relates to the field of data processing, and provides a method and device for asynchronously updating multiple channels of image data. The method includes: creating multiple graphics buffer memory blocks and multiple external extension textures; based on the application extension interface, establishing a binding relationship between each external extension texture and each graphics buffer memory block, and storing the binding relationship in a relationship cache set; if it is detected that the non-shared memory of the CPU writes at least one channel of newly added image data, then determining the target graphics buffer memory block and target external extension texture corresponding to each channel of newly added image data; for each channel of newly added image data, running a data writing thread, and writing the newly added image data into the corresponding target graphics buffer memory block. The present application improves the overall synchronization efficiency of multiple channels of image data, shortens the time consumed for overall synchronization update, and greatly reduces the CPU load.

The invention discloses a system software synchronization method and device, equipment and a storage medium, and the method comprises the steps: obtaining a software information set synchronized from a second system to a first system in the first system, and obtaining a first software information set; obtaining a to-be-synchronized software information set in a second system, and obtaining a second software information set; traversing each piece of second software information in the second software information set, and updating the first software information set according to the traversed second software information until the second software information in the second software information set is traversed; obtaining a difference set of the updated first software information set and the second software information set, and removing software information in the difference set from the updated first software information set to obtain a target first software information set; the system software synchronization efficiency is effectively improved, manual intervention is reduced, and errors caused by manual operation are avoided.

This application discloses a method, apparatus, and electronic device for synchronizing Hive data tables between clusters. Relating to the field of big data technology, the method includes: acquiring source cluster information, wherein the source cluster information includes at least: the name of the source cluster, the name of the Hive database in the source cluster, and the name of the Hive data table to be synchronized in the Hive database of the source cluster; determining target information of the Hive data table to be synchronized based on the source cluster information, wherein the target information includes at least: table structure information and authorization information, wherein the authorization information includes at least: the authorized object to which the permission belongs and the permission name; processing the target information to obtain processed target information; and synchronizing the processed target information to the target Hive data table in the Hive database of the target cluster. This application solves the problem of low synchronization efficiency of Hive tables across clusters in related technologies.

The embodiment of the present application provides a data synchronization verification method, system, computing device and storage medium. In the embodiment of the present application, within a predetermined time, the operating frame rate of the client installed in the terminal is greater than the operating frame rate of the server within a preset range, receives the first frame data packet, executes the first operation instruction, and obtains the first operation result; stores the correspondence between the first operation result and the first frame packet identifier to the corresponding cache queue; sends the first operation result to the corresponding multiple terminals through a frame message packet, and the frame message packet carries a second frame packet identifier corresponding to the first frame packet identifier. Thereby, after receiving the frame message packet, the terminal returns the second operation instruction and the frame packet identifier corresponding to the operation result before the second operation instruction through the second frame data packet to verify the second operation instruction. Thereby, the operation result can be verified more accurately for state synchronization.

A multi-terminal data synchronization and secure storage method, device, program product and medium, relating to the technical field of mobile Internet, by dividing learning data into dynamic interactive data and static resource data, and managing the change history of dynamic interactive data through version index tree, so that the system can accurately locate the data version that needs to be synchronized. When the second terminal requests data synchronization, the system only transmits the necessary target data, and realizes on-demand access of static resources through access token mechanism, avoiding repeated transmission of large resource files. This data classification and incremental synchronization based method significantly reduces network transmission overhead and improves the efficiency of multi-terminal data synchronization. At the same time, by separating the access control of static resource data and the synchronization transmission of dynamic interactive data, the safe use of electronic resources is guaranteed, and the needs of users to flexibly switch learning among multiple terminals are met.

The invention discloses a time service method and device based on underwater acoustic communication, electronic equipment and a storage medium, and relates to the field of underwater acoustic communication, the method is applied to slave equipment, and the method specifically comprises the following steps: generating multi-byte first underwater acoustic information according to local time, and sending the first underwater acoustic information to master equipment; generating a first pulse signal according to the first underwater sound information, and marking a first timestamp on the edge of the first pulse signal; generating a second pulse signal according to second underwater sound information fed back by the main equipment, and marking a second timestamp on the edge of the second pulse signal; and updating local time according to the first timestamp, the second timestamp and first time service information fed back by the master device. According to the technical scheme of the embodiment of the invention, the clock consistency between the master device and the slave device is realized, the clock signal synchronization efficiency is improved, and the signal transmission distance is greatly expanded while wireless signal transmission is realized based on a transmission mode of underwater acoustic communication.

The invention discloses a gradient data synchronization method and device for distributed training, a medium and a product, and relates to the technical field of computers, and the method comprises the steps: obtaining a two-dimensional network topology structure of a distributed training system; wherein the two-dimensional network topology structure comprises a plurality of nodes and directed links between adjacent nodes; n path trees are generated based on the two-dimensional network topology structure, the N path trees do not contain the same directed link, and a set of nodes contained in the N path trees covers all nodes in the two-dimensional network topology structure; a node in the distributed training system divides gradient data to be synchronized into N data blocks, and data synchronization operation is performed on the N data blocks based on N path trees. The gradient data synchronization efficiency in the distributed training process is improved.

The present invention discloses a data batch synchronization method, device, computer equipment and storage medium, including: obtaining a source storage directory of data to be synchronized, generating a corresponding list of directories to be synchronized; sequentially obtaining at least two directories to be synchronized in the list of directories to be synchronized as the current synchronization processing batch, assigning each directory to be synchronized in the current synchronization processing batch to a corresponding synchronization thread, and executing the operation of synchronizing the current level data in each directory to be synchronized to a target directory matching each directory to be synchronized through each synchronization thread; when it is determined that the batch synchronization condition is met, again executing the operation of obtaining the remaining at least two directories to be synchronized in the list of directories to be synchronized as a new synchronization processing batch, and assigning each directory to be synchronized in the new synchronization processing batch to a corresponding synchronization thread. The technical solution of the embodiment of the present invention can realize batch parallel processing of multiple data synchronization tasks, thereby improving the efficiency of data synchronization.

The embodiments of the present application disclose an information synchronization method, device, electronic device and computer-readable storage medium, the method comprising: receiving scene information and user instructions of the current scene sent by the terminal; obtaining pre-stored scene fields according to the identifier of the current scene; generating switching instructions based on user instructions, pre-stored scene fields and characteristic information to instruct the terminal to switch the current scene accordingly. New scene information is determined by user instructions, scene fields and characteristic information of the scene to achieve updating and synchronization of scene information. By transmitting the identifier of the scene to the server, the server can obtain the scene field information of the scene according to the identifier of the scene, and the direct transmission of the scene field is replaced by the identifier of the scene, thereby reducing the amount of data transmitted during information synchronization and improving the efficiency of information synchronization.

The embodiments of the present application provide a method, device and storage medium for synchronizing sessions of primary and standby virtual machines, and relate to the technical field of data synchronization. The method comprises: mounting the shared directories of shared files to the virtual shared directories of the primary and standby virtual machines respectively through the host machine, so that the primary virtual machine and the standby virtual machine respectively map the shared files to their respective shared virtual memories; responding to the session synchronization request of the standby virtual machine through the primary virtual machine, and copying the session data of the primary virtual machine to the shared virtual memory of the primary virtual machine, so that the standby virtual machine synchronizes the session data to the standby virtual machine based on the shared virtual memory of the standby virtual machine. The embodiments of the present application mount the directories of shared files to the primary and standby virtual machines respectively, and map the shared files to the virtual memories of the primary and standby virtual machines respectively, so that the primary and standby virtual machines can realize fast synchronization of session data through shared memory, thereby effectively improving the efficiency of session synchronization of the primary and standby virtual machines.

The invention relates to a data encryption method and device, electronic equipment and a storage medium. The method comprises the following steps: after password data of a first password lock in the intelligent door lock is updated, determining priorities of updated password data and synchronization time corresponding to different priorities according to an attribute of a second password lock, a type of the updated password data and / or a user attribute of the updated password data; at the synchronization time corresponding to the priority, the first password lock encrypts the updated password data of the corresponding priority by using a first private key of the first password lock and a first public key of the second password lock to obtain a first target password file; synchronizing the first target password file to a second password lock through the first password lock, and obtaining a second public key of the first password lock and a second private key of the second password lock through the second password lock; and the second coded lock decrypts the first target password file according to the second public key and the second private key to obtain the updated password data of the corresponding priority in the first coded lock.

Embodiments of the present application disclose a process recipe updating method and device and a computer device. Embodiments of the present application can display a process recipe updating page of a process recipe management system, the process recipe updating page comprising a plurality of object identifiers, the plurality of objects comprising the process recipe management system and at least one semiconductor device in communication connection with the process recipe management system, and the objects storing a process recipe set. In response to a selection operation on a first object identifier, a plurality of process recipe identifiers contained in the first object are displayed. In response to a selection operation on at least one first target process recipe identifier of the first object, a first target process recipe to be transmitted is determined. In response to an updating operation on the first target process recipe, the first target process recipe is transmitted to at least one second object, and updating state information is displayed on the process recipe updating page, thereby efficiently synchronizing the process recipe among the plurality of semiconductor devices.

The embodiment of the invention provides a media content processing method and device, equipment, a readable storage medium and a product, and the method comprises the steps: obtaining at least one collection operation triggered by a user for at least one piece of media content within a time interval after the user is fully authorized; in response to the fact that the preset synchronization condition is met, list updating information newly added in the time interval of a pre-stored first collection list is obtained from a preset server; performing collection list updating operation on a second collection list corresponding to the current client based on the list updating information to obtain an updated target collection list; and determining at least one to-be-updated content based on the first favorite list and the target favorite list, and sending the at least one to-be-updated content to the server. Therefore, the collected data synchronization operation can be accurately carried out on the second collected list of each client based on the first collected list. And only the incremental to-be-updated content is subjected to data transmission, so that the data transmission quantity can be reduced, and the content synchronization efficiency is improved.

The invention discloses a key distribution method based on a hierarchical hash chain. The method is used for a password management service platform, and comprises the following steps: generating a session key and a key identifier according to a received session key generation request sent by a first terminal, and sending the session key and the key identifier to the first terminal; receiving a session key acquisition request sent by the second terminal, and verifying the validity of the identity of the second terminal according to verification information submitted by the second terminal; and under the condition that the verification is passed, issuing the session key to the second terminal. Thus, the service platform generates the first Hash chain fragment bound with the terminal permission, so that the password management service platform not only can verify the authenticity of the terminal identity during verification, but also can accurately verify whether the terminal has the legal key application permission, thereby effectively blocking the path of applying for the session key by stealing the key identifier by an illegal user, and improving the user experience. And the risk that the session key is illegally stolen is reduced, so that the security and reliability of encrypted communication between the terminals are ensured.

The embodiment of the invention relates to the field of databases, and discloses a data synchronization method, system and device and a storage medium, the data synchronization method is applied to a main database, and comprises the following steps: when data update occurs in the main database, inserting update information corresponding to update data into a data table located in the main database; and reading the newly inserted update information from the data table, and pushing the read update information to a message queue server, so that a message consumer monitors and obtains the latest update information from the message queue server, and synchronizes the latest update information to the slave database, so that the slave database completes update data synchronization. According to the data synchronization method disclosed by the invention, the problems of data updating delay and low synchronization efficiency are solved, and at least the security and the synchronization efficiency of data synchronization can be improved.

The application provides a kind of data offline synchronization method based on MQTT protocol client and server, it is related to information technology field, including that client and server establish MQTT long connection;Client encapsulates message synchronization interface, and judges current network state in interface, if network is unobstructed, go online mode, if network is not connected, go offline mode;In online mode, data is directly synchronized to server through MQTT connection;In offline mode, client first caches synchronization data, and checks network state regularly, when network recovers, immediately start synchronization task;Server receives message, and parses data according to message type and handles it.The application can be applied in places with good network environment such as shopping mall, office building, street, etc., and also can be applied in places with poor network environment such as field, mountainous area, jungle, etc., with wider application scenarios.Using the characteristics of MQTT publishing and subscribing, when a large amount of data is used, the server can process data on demand, reduce the pressure on the service, and improve the stability of the service.

This invention belongs to the field of blockchain technology, specifically relating to a method for synchronizing the activity state between blockchains. The method executes the following steps: Step 1: Grouping the target blockchain into several sub-blockchains; each blockchain contains at least two nodes. It achieves state and data synchronization between blockchains by adding routers and synchronizers to the blockchains; routers ensure real-time data collection and generate identifier codes; synchronizers control the routers to achieve synchronization. During synchronization, the synchronizer uses an algorithm to determine whether synchronization is necessary, based on data collected by the routers, thus improving synchronization efficiency. Compared to existing technologies that require continuous acquisition of data from each node for synchronization, this method significantly reduces complexity and effectively avoids the situation where synchronization is performed when it is not needed, thus consuming system resources.

The present application relates to a configuration parameter synchronization method, device, computer equipment and readable storage medium. The method comprises: obtaining a target device set; in the process of synchronizing configuration parameters to target devices in the target device set based on a configuration file, when a current target device that has completed configuration parameter synchronization is detected, the current target device is used as a newly added source device; the target devices in the target device set that have not started configuration parameter synchronization are divided to obtain a first processing device set corresponding to the current source device and a second processing device set corresponding to the newly added source device; based on the configuration file, the configuration parameters are continued to be synchronized to the target devices in the first processing device set, and the configuration parameter synchronization authority corresponding to the second processing device set is allocated to the newly added source device, so that the newly added source device synchronizes the configuration parameters to the target devices in the second processing device set based on the local configuration file. The use of this method can improve the efficiency of configuration parameter synchronization.