A data association method and system

A data association, key-value pair technology, applied in the field of data processing, can solve the problem of low association accuracy, and achieve the effect of high data association accuracy and low data association cost

Active Publication Date: 2021-08-31
上海缤游网络科技有限公司
View PDF20 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, an embodiment of the present invention provides a data association method and system to solve the problems of low association accuracy existing in existing data association methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data association method and system
  • A data association method and system
  • A data association method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0036] In this application, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes none. other elements specifically listed, or also include elements inherent in such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "com...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a data association method and system. The method includes: obtaining a first key-value pair from a first message queue. Based on the first key of the first key-value pair, query whether there is a second key-value pair of the second message queue whose key is equal to the first key from the preset key-value pair storage. If so, merge the first key-value pair and the second key-value pair, and output the merged first key-value pair and the second key-value pair. If not, store the first key-value pair in the key-value pair memory. In this solution, the first key-value pair is obtained from the first message queue that needs data association, and whether there is a second key-value pair whose key is equal to the first key is queried from the key-value pair storage. If so, merge and output the first key-value pair and the second key-value pair. If not, the first key-value pair is stored in the key-value pair storage for query by message queues that need to perform data association with the first message queue. Realize real-time correlation between multiple message queues, with high correlation accuracy and low correlation cost.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data association method and system. Background technique [0002] With the rapid development of the field of big data, more and more enterprises are applying technologies related to big data to their own business. Among them, the more common technical products related to big data are data warehouses. [0003] Before applying the data warehouse to implement functions such as data storage and data analysis, the data needs to be extracted, transformed and loaded (Extract, Transform and Load, ETL). In the process of ETL, it is usually necessary to merge multiple data sources into one data source. At present, the more common data source merging method is to realize the merging of data sources based on the key-value pairs (key:value) of the compared data sources. The specific implementation method is: for example, for the first data source and the second data source with mu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/2457G06F16/25
CPCG06F16/24578G06F16/254
Inventor 崔智经
Owner 上海缤游网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap