Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A massive data association method based on redis cluster

A basic data and cluster technology, applied in data mining, database model, database index, etc., can solve problems such as difficulties for developers and inability of business personnel to deploy business, so as to reduce copying, improve data processing capabilities, and facilitate parsing and association Effect

Active Publication Date: 2022-01-11
RUN TECH CO LTD BEIJING
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method can meet the requirements of timeliness, but when faced with a large number of business rules with various types and types, it is difficult for developers to respond in a timely manner, and business personnel cannot perform business deployment alone

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A massive data association method based on redis cluster
  • A massive data association method based on redis cluster
  • A massive data association method based on redis cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0079] The following strategy is the association strategy for backfilling the mobile phone number based on the authentication account of the business data.

[0080]

[0081] According to the sequence of the process, it is described as follows:

[0082] First, the association module will filter the basic data according to the DataSet="WA_BASIC_0021" in the BuildDBField tag and the condition in the Conditions tag. If the basic data protocol is WA_BASIC_0021 and the data If the source is 124, then this piece of data meets the associated storage conditions. The association module will use the value encoded by B040022 in the Expression tag as the key, and the value of B050004 in the DestElement tag as value to be stored in the redis cluster in cluster mode.

[0083] Secondly, the association module will filter the business data according to the SubDataSet="WA_SOURCE" in the QueryDBField tag and the condition in the Conditions tag. If the first nine digits of the bi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a massive data association method based on redis cluster. This method is as follows: 1) Create a Redis memory database cluster, and use the memory database redis to store basic data; among them, use zset to store the data whose key word is an IP address and the basic data is an IP address segment, and use the json format to store the data in the form of a string Store other basic data; 2) configure a standardized association policy file in the association system; 3) the association system selects the set association field from the log data to form an association key according to the standardized association policy file, and then according to the key value from The matching basic data is associated in the memory database redis; 4) The association system fills the associated basic data into the corresponding fields of the log data according to the backfill field information configured in the standardized association policy file. The invention facilitates the analysis and association of data and improves the data processing capability.

Description

technical field [0001] The invention relates to the technical field of computer information security, and is a redis-based, high-real-time, high-reliability, and high-stability association method aimed at massive real-time data streams. Background technique [0002] With the development of information technology, especially the arrival of the era of big data, more and more industries need to correlate and fuse data from different sources to dig out the maximum value of data. For example, the WXXA industry needs to correlate the log data of users' wireless Internet access, use the tunnel number in the log data as the keyword, query the basic authentication database, and backfill the found relevant data (calling number, IMSI, device number) into the log data for Subsequent use of each business module. [0003] Traditional data association methods can be roughly divided into two categories: [0004] 1. Store the converted basic data in the memory linked list of the single-nod...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/27G06F16/2455G06F16/28
CPCG06F16/22G06F16/2465G06F16/27G06F16/951G06F2216/03
Inventor 王雪松肖志东
Owner RUN TECH CO LTD BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com