Unlock instant, AI-driven research and patent intelligence for your innovation.

Data comparison method, device and system

A data comparison and data item technology, applied in the field of data processing, can solve problems such as time-consuming, difficult to directly reuse data, and inconvenient troubleshooting

Active Publication Date: 2017-03-15
ALIBABA (CHINA) CO LTD
View PDF5 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

First of all, since the developed script is for the data generated by a single system, it is difficult to directly reuse the data generated by different systems
Second, the use of scripts for data comparison results in low processing efficiency and usually takes too long for large systems
Third, it is inconvenient to troubleshoot the problem. Even if the problem is found after the data comparison is completed, it is difficult to quickly find the original data before the data comparison
Fourth, some data formats are difficult to read with scripts

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data comparison method, device and system
  • Data comparison method, device and system
  • Data comparison method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] Preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although preferred embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0033]Due to the large amount of data to be processed, the data comparison of large-scale systems cannot be implemented on a single machine usually due to memory constraints. In addition, in the prior art, the comparison script specially developed for each system takes too long to run once. In the case of various data types, multiple scripts need to be developed. The above-mentioned problems all lead to inefficiency of data comparison solu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data comparison method, device and system. The data comparison method comprises the following steps: converting, i.e., converting multiple data items contained in each of an acquired first data set and an acquired second data set by utilizing a distributed computing architecture, so that the converted data items have a uniform data structure, wherein the uniform data structure comprises multiple fields; comparing, i.e., comparing the multiple converted data items in the first data set and the second data set according to a configuration file by utilizing the distributed computing architecture. A client can make a brief or detailed configuration for data comparison according to needs by utilizing the configuration file, thus realizing quick and efficient comparison on big data by utilizing a distributed platform.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a data comparison method, device and system. Background technique [0002] With the increasing prosperity of computer technology and business activities, system maintainers need to reconfigure and iterate the system more and more frequently to meet the needs of system upgrades or business mergers. System-level reconstruction usually requires comparison of data before and after operation and between different versions to verify the correctness of the system. However, the diversification of the system leads to the diversification of the data format that needs to be processed, the diversification of the data storage method and the difference in the size of the data. In addition, for large-scale systems, due to the huge amount of data (for example, the amount of PB-level data), it cannot be managed within a reasonable time by current mainstream software tools, so it usually requires t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/25G06F16/273
Inventor 王方国陈银锋唐铭员
Owner ALIBABA (CHINA) CO LTD