Data comparison system and method

A data comparison and data technology, applied in the computer field, can solve problems such as difficulty in single-machine execution, high data sequence dependence, and low comparison efficiency, and achieve the effect of improving data comparison efficiency and avoiding data sequence dependence

Active Publication Date: 2018-08-14
BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In this way, in the process of comparing big data, the data sequence dependence in the file is high, it is difficult to execute on a single machine, and the comparison efficiency is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data comparison system and method
  • Data comparison system and method
  • Data comparison system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention. On the contrary, the embodiments of the present invention include all changes, modifications and equivalents coming within the spirit and scope of the appended claims.

[0029] figure 1 It is a schematic structural diagram of a data comparison system proposed by an embodiment of the present invention.

[0030]With the development of big data technology in the computer field, in the process of big data application and processing, it is necessary to compare the consistency of data in two files. An application scenario. For example, a proje...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data comparison system and method. The data comparison system comprises a mapping module, a combination module and a reduction module, wherein the mapping module is used forrespectively mapping to-be-compared first data and to-be-compared second data, so as to obtain first key value pairs of multiple rows of data in the first data and second key value pairs in multiple rows of data in the second data; the combination module is used for respectively sorting the first key value pairs and the second key value pairs so as to obtain sorted first key value pairs and sortedsecond key value pairs, and combining the sorted first key value pairs and the sorted second key value pairs so as to obtain a combination result; and the reduction module is used for judging whethervalues of the key value pairs in the combination result are the same or not so as to obtain a judging result, and comparing the to-be-compared first data and the to-be-compared second data accordingto the judging result. Through the system and method, dependency on data sequences in files can be avoided, and the data comparison efficiency is effectively enhanced.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data comparison system and method. Background technique [0002] With the development of big data technology in the computer field, in the process of big data application and processing, it is necessary to compare the consistency of data in two files. An application scenario. For example, a project A on the original product line needs to verify the correctness of execution after the upgrade. By comparing the original program of project A and the upgraded version of project A, the project Verify whether the content output by A is consistent or not. [0003] In related technologies, the data comparison method is based on a single machine for comparison processing, and the contents of the two input files for comparison are required to be in order. For example, file a contains three lines of data: data A, data B, and data C , and file b contains three rows of data: data B, data...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/22
CPCG06F40/194
Inventor 米博会魏庆滨张磊
Owner BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products