Data reconciliation method and related device

A data pair and data technology, applied in the field of data reconciliation methods and related devices, can solve the problems of long time-consuming reconciliation and low reconciliation efficiency

Active Publication Date: 2019-12-06
ZHEJIANG DAHUA TECH CO LTD
View PDF7 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the face of massive data, the use of full table data reconciliation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data reconciliation method and related device
  • Data reconciliation method and related device
  • Data reconciliation method and related device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The solutions of the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings.

[0023] In the following description, for purposes of illustration rather than limitation, specific details, such as specific system architectures, interfaces, and techniques, are set forth in order to provide a thorough understanding of the present application.

[0024] The terms "system" and "network" are often used interchangeably herein. The term "and / or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations. In addition, the character " / " in this article generally indicates that the contextual objects are an "or" relationship. In addition, "many" herein means two or more than two.

[0025] see figure 1 , figure 1 It ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data reconciliation method and a related device. The data reconciliation method comprises the following steps: acquiring an actual data volume received by a destination end from a source end within a set time period; obtaining a theoretical data volume received from the source end in a set time period by utilizing the account checking number of each piece of data, whereinthe reconciliation number comprises the number and the offset of the partition of the data, and the offset in each partition is continuously increased progressively; judging whether the actual data volume is equal to the theoretical data volume or not; and if the actual data volume is not equal to the theoretical data volume, supplementing missing data or deleting repeated data. According to thescheme, the data reconciliation duration can be shortened, and the data reconciliation efficiency is improved.

Description

technical field [0001] The present application relates to the technical field of data processing, in particular to a data reconciliation method and related devices. Background technique [0002] With the rapid development of information technology, people's online shopping and chatting in daily life will generate massive amounts of data. In order to break through the bottleneck of centralized storage in terms of reliability and security when processing massive data, distributed storage technologies, such as Kafka message queues, have been gradually developed. [0003] In the scenario of real-time data synchronization, especially in the process of cross-network data transmission, when abnormal conditions such as network instability, server exception, and message backlog occur, the data in the source database and the destination database may be inconsistent, for example: Data in the database at the destination is missing, or data in the database at the destination is duplicat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/215G06F16/242G06F16/2458G06F16/25
CPCG06F16/215G06F16/2433G06F16/2462G06F16/258
Inventor 王亮何林强
Owner ZHEJIANG DAHUA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap