Data reconciliation method and related device

A technology for data pairing and data, applied in the field of data reconciliation methods and related devices, can solve the problems of low reconciliation efficiency and long reconciliation time, so as to improve compatibility, save data reconciliation time, and improve data reconciliation efficiency Effect

Active Publication Date: 2022-08-09
ZHEJIANG DAHUA TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the face of massive data, the use of full table data reconciliation has the problems of long reconciliation time and low reconciliation efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data reconciliation method and related device
  • Data reconciliation method and related device
  • Data reconciliation method and related device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The solutions of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0023] In the following description, for purposes of illustration and not limitation, specific details such as specific system structures, interfaces, techniques, etc. are set forth in order to provide a thorough understanding of the present application.

[0024] The terms "system" and "network" are often used interchangeably herein. The term "and / or" in this article is only an association relationship to describe the associated objects, indicating that there can be three kinds of relationships, for example, A and / or B, it can mean that A exists alone, A and B exist at the same time, and A and B exist independently B these three cases. In addition, the character " / " in this document generally indicates that the related objects are an "or" relationship. Also, "multiple" herein means two or more than two.

[0025] see figure 1 , ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present application discloses a data reconciliation method and a related device. Among them, the data reconciliation method includes: obtaining the actual amount of data received by the destination end from the source end within a set time period; using the reconciliation number of each piece of data to obtain theoretical data received from the source end within the set time period Data volume; the reconciliation number includes the partition number and offset of the data, and the offset in each partition increases continuously; judge whether the actual data volume is equal to the theoretical data volume; if the actual data volume is different from the theoretical data volume Equal, complement missing data or remove duplicate data. The above solution can reduce the data reconciliation time and improve the data reconciliation efficiency.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular, to a data reconciliation method and related devices. Background technique [0002] With the rapid development of information technology, people's online shopping and chatting in daily life will generate massive data. In order to break through the bottlenecks in reliability and security when centralized storage processes massive data, distributed storage technologies, such as Kafka message queues, have been gradually developed. [0003] In the scenario of real-time data synchronization, especially in the process of cross-network data transmission, when there are abnormal situations such as network instability, server abnormality, and message backlog, the data of the source database and the destination database may be inconsistent, for example: The data in the end database is missing, or the data in the destination database is duplicated. In order to supplemen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/215G06F16/242G06F16/2458G06F16/25
CPCG06F16/215G06F16/2433G06F16/2462G06F16/258
Inventor 王亮何林强
Owner ZHEJIANG DAHUA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap