Unlock instant, AI-driven research and patent intelligence for your innovation.

Data association method and device, server and storage medium

A data association and data technology, applied in the field of communication, can solve the problem that the time window cannot be set infinitely long, and achieve the effect of ensuring data processing performance and timeliness

Pending Publication Date: 2021-10-19
北京红山信息科技研究院有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this solution also brings some problems. For example, it is impossible to set the time window to be infinitely long. When the window is longer, the amount of calculation will increase, which will cause serious performance problems.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data association method and device, server and storage medium
  • Data association method and device, server and storage medium
  • Data association method and device, server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] figure 1 A flowchart of a data association method provided by the embodiment of the present invention, and an embodiment of the present invention can be applied to a real-time association of wireless data and signaling data. The method of the embodiment of the present invention can be performed by a data association device, which can be implemented by software and / or hardware and can generally be integrated into a server or terminal device. Refer figure 1 , The data association method of the embodiment of the present invention includes the following steps:

[0039]Step S110, log acquisition, access signaling data, and wireless data are performed using Flume.

[0040] Specifically, signaling data includes, but is not limited to, user information (user mobile phone number MSISDN, terminal identifier IMEI, user IMSI, terminal model), base station information (endbid, cellid, mmecode, mmes1apid, mmegroupid, etc.). For example, the data format can be a timestamp 1+ base stati...

Embodiment 2

[0059] One data associated device according to the embodiment of the present invention can perform the data association method provided by any embodiment of the present invention, with functional modules and beneficial effects corresponding to the method, which can be implemented by software and / or hardware (integrated circuit) Implementation and generally be integrated into a server or terminal device. figure 2 It is a schematic structural diagram of a data associated apparatus according to the second embodiment of the present invention. Refer figure 2 The data association device 200 of the embodiment of the present invention can include:

[0060] The acquisition unit 210 is used to use the Flume to log acquisition, access signaling data, and wireless data;

[0061] The storage unit 220 is configured to store the signaling data and the wireless data into the KAFKA cluster while writing the signaling data and the wireless data shunt in the HBASE and Hive cluster;

[0062] The as...

Embodiment 3

[0080] image 3 A configuration diagram of a server provided in the third embodiment of the present invention, such as image 3 As shown, the server includes processor 310, memory 320, input device 330, and output device 340; the number of processor 310 in the server can be one or more, image 3 In one processor 310 as an example; processor 310, memory 320, input device 330, and output devices 340 can be connected by bus or other means. image 3 In connection with the bus connection.

[0081] The memory 320 is used as a computer readable storage medium, which can be used to store software programs, computer executors, and modules, such as program instructions / modules (e.g., acquisition units in data association), such as data association methods in the embodiment of the present invention. 210, deposit unit 220 and associated unit 230). The processor 310 performs various functional applications and data processing of the server by operating the software programs, instructions, and m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data association method and device, a server and a storage medium. The method comprises the following steps: carrying out log acquisition by adopting flume, and accessing signaling data and wireless data; storing the signaling data and the wireless data in a kafka cluster, and writing the signaling data and the wireless data into an hbase cluster and a hive cluster in a distributed mode; and associating the signaling data and the wireless data through flink, distributing and writing obtained associated data into the hbase and hive clusters, wherein associated fields are obtained by taking the same base station information in the signaling data and the wireless data as associated fields, taking a timestamp of the signaling data as a starting time point, taking service duration as a time period, and searching for data meeting association conditions in the wireless data. According to the technical scheme, effective association of two pieces of data is guaranteed through real-time association calculation, and even if one or more pieces of data are delayed, it can be guaranteed that delayed data is effectively processed while the data processing performance and timeliness are guaranteed.

Description

Technical field [0001] Embodiments of the present invention relate to the field of communication, and more particularly to a data association method, apparatus, server, and storage medium. Background technique [0002] Currently in real-time flow data, there are many open source components, such as Storm, Flink, SparkStream, etc., which are handled in real-time single-flow data. However, most of the actual business development is dual flow data, including signaling data and wireless data. Signaling data records user-side terminal information, such as user mobile phone number MSISDN, terminal identifier IMEI, user IMSI, terminal model, terminal connection base station endbid, cellid, mmecode, mmes1apid, mmegroupID, etc. Information. The wireless data records the user terminal connection base station ENDBID, CELLID, MMECODE, MMES1APID, MMEGroupID, and other information, and the terminal location information LAT, LON, terminal work state wireless signal information RSRP, RSRQ, SINR,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04W24/04H04W4/20H04W24/08
CPCH04W24/04H04W4/20H04W24/08
Inventor 向阳刘亮林昀
Owner 北京红山信息科技研究院有限公司