Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Large-scale data comparison method based on fragmentation technology

A data comparison and large model technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of time-consuming, etc., and achieve the goal of improving comparison efficiency, ensuring disjointness and integrity, and ensuring integrity Effect

Active Publication Date: 2015-02-25
NARI TECH CO LTD +1
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For tables of this magnitude, the traditional single-workflow comparison method may have the problem that the comparison process takes a long time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-scale data comparison method based on fragmentation technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] In order to make the technical means, creative features, goals and effects achieved by the present invention easy to understand, the present invention will be further described below in conjunction with specific embodiments.

[0019] A large model data comparison method based on fragmentation technology of the present invention. The model tables in the distribution network system generally have keywords, which provides the possibility of fragment comparison by keywords. The present invention mainly aims at the model data table with a large number of records, sets the fragmentation parameters according to the needs, and then obtains the fragmentation content from the reference data source and the data source to be compared according to the fragmentation parameters, and compares multiple fragments at the same time, and finally Get diff results. The difference result is composed of a difference identifier and a difference content description. The difference identifier has...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a large-scale data comparison method based on the fragmentation technology. The large-scale data comparison method comprises the following steps of setting fragment parameters, taking out all keywords of a reference data source, arranging the keywords in sequence from small to big, and storing the keywords into a keyword number set; working out the number (fragment_num) of fragments and a record number in each fragment, and then obtaining head and tail keyword values of each fragment from the keyword number set in sequence; starting a working thread for each fragment, wherein each working thread obtains corresponding data contents from the reference data source and a data source to be compared; comparing the distributed data contents line by line by each working thread, and recording a difference result; after processing is finished by all the working threads, obtaining the difference result with the number being fragment-num, and joining all the difference results into a final difference result. The large-scale data comparison method is applied into two systems or two databases, and the large-scale data comparison efficiency can be greatly improved.

Description

technical field [0001] The invention relates to a large model data comparison method based on fragmentation technology, and belongs to the technical field of power system automation distribution network model management. Background technique [0002] The data volume of the distribution network model is relatively large, and the number of records in a model table is likely to reach the million level. For tables of this order of magnitude, the traditional single-workflow comparison method may have the problem that the comparison process takes a long time. Contents of the invention [0003] In view of the deficiencies in the prior art, the purpose of the present invention is to provide a method for comparing large model data based on fragmentation technology that can greatly improve the efficiency of large model data comparison when applied in two systems or two databases. [0004] In order to achieve the above object, the present invention is achieved through the following ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2458
Inventor 王昌频王飞季惠英季学纯
Owner NARI TECH CO LTD
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com