Supercharge Your Innovation With Domain-Expert AI Agents!

Data synchronization method and device, equipment and computer readable storage medium

A data synchronization and data storage technology, applied in the field of big data processing, can solve the problems of large data repetition and long time, and achieve the effect of reducing resource occupancy rate and improving resource utilization rate

Pending Publication Date: 2020-01-03
CHINA PING AN PROPERTY INSURANCE CO LTD
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of the present invention is to provide a data synchronization method, device, equipment, and computer-readable storage medium, aiming to solve the problem that in the existing data synchronization method, the data of each synchronization is relatively repetitive, resulting in too long time question

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method and device, equipment and computer readable storage medium
  • Data synchronization method and device, equipment and computer readable storage medium
  • Data synchronization method and device, equipment and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0061] The invention provides a data synchronization device.

[0062] refer to figure 1 , figure 1 It is a schematic structural diagram of the operating environment of the data synchronization device involved in the solution of the embodiment of the present invention.

[0063] Such as figure 1 As shown, the data synchronization device includes: a processor 101 , such as a CPU, a communication bus 102 , a user interface 103 , a network interface 104 , and a memory 105 . Wherein, the communication bus 102 is used to realize connection and communication between these components. The user interface 103 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the network interface 104 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface). ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of big data processing, and discloses a data synchronization method. The method includes: determining incremental task data in the to-be-synchronized taskdata table according to the to-be-synchronized task data table, the second check code of the task data in the task data table, the historical data and the first verification code of the task data in the historical data, and only synchronizing the incremental task data during synchronization. the invention further provides a data synchronization device and equipment and a computer readable storagemedium, and by means of the data synchronization mode, data in the synchronization process are reduced, the data synchronization time is shortened, the resource occupancy rate of the equipment duringsynchronization is also reduced, and the resource utilization rate of the equipment is increased.

Description

technical field [0001] The present invention relates to the technical field of big data processing, in particular to a data synchronization method, device, equipment and computer-readable storage medium. Background technique [0002] Hive is a basic data warehouse tool based on Hadoop. To some extent, it can be regarded as a user programming interface (API). It does not store and process data itself, but relies on HDFS to store data and MR to process data. It provides a series of tools for extracting, transforming and loading data. Rely on HDFS to store data and rely on MR to process data. Used in Hadoop to process structured data. Hive Query Language uses Hive to process structured data for MapReduce. Hive is not a real-time query language. [0003] In actual development, it is often used for data cleaning, storage and analysis, for example: processing data on Hive, and then importing data to real-time query engines, such as: Hbase, ElasticSearch, for real-time query by...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/23G06F16/27
CPCG06F16/23G06F16/27
Inventor 许浩奇刘广平
Owner CHINA PING AN PROPERTY INSURANCE CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com