Unlock instant, AI-driven research and patent intelligence for your innovation.

Data reading method and system

A data reading and data technology, applied in the field of communication, can solve the problems of reducing the efficiency of data reading and failing to meet the real-time performance of data reading

Inactive Publication Date: 2018-01-23
中国移动通信集团重庆有限公司
View PDF3 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, since the execution process of the SQL statement is to read the database once, as the amount of data grows, using the existing data reading method will reduce the efficiency of data reading and cannot meet the real-time nature of data reading

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data reading method and system
  • Data reading method and system
  • Data reading method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] figure 1 Schematic flowchart of a data reading method provided by an embodiment of the present invention Figure 1 , the method is applied to the data reading system, and the data reading methods include:

[0045] Step 101: Using distributed data transmission channels to collect data stored by at least one client;

[0046] Wherein, the data includes different clients, that is, data stored by client systems. Wherein, the client system may include a signaling system, a deep packet inspection (DPI, deep packet inspection) system, a business operation support system (BOSS, Business&Operation Support System) and the like. Among them, various client systems such as signaling system, DPI, BOSS system, etc. constitute a heterogeneous database system.

[0047] For example, the data generated by the BOSS system includes interface files and signaling messages. In practice, to obtain the data generated by the BOSS system, the IMSI information, phone number, customer information...

Embodiment 2

[0077] image 3 Schematic structure of a data reading system provided by the embodiment of the present invention Figure 1 , distributed collection device 101, distributed file management unit 102 and data reading device 103, wherein:

[0078] A distributed collection device 101, configured to use a distributed data transmission channel to collect data stored by at least one client;

[0079] The distributed file management unit 102 is used to store the data collected by the distributed collection device 101, and the distributed file management unit 102 is based on a distributed database cluster;

[0080] The data reading device 103 is configured to read the first data corresponding to the reading instruction stored in the distributed file management unit 102 when receiving the reading instruction.

[0081] Further, the distributed file management unit 102 includes a Hadoop distributed file management unit HDFS, and the distributed database cluster includes a Redis cluster. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data reading method and system, can improve data reading efficiency, and meets data reading instantaneity. The method comprises the following steps that: utilizing a distributed data transmission channel to collect data stored in at least one client side; storing the data into a distributed file management unit, wherein the distributed file management unit is based on a distributed database cluster; and when a reading instruction is received, reading first data which is stored in the distributed file management unit and corresponds to the reading instruction.

Description

technical field [0001] The invention relates to the communication field, in particular to a data reading method and system. Background technique [0002] With the advent of the era of big data, a large amount of data will be generated in various fields, such as signaling log data of communication operators, data of log files, data generated by distributed database clusters, etc. Real-time statistical analysis of data. [0003] Since most of the data is generated across network elements, and the data generated by each network element is usually not uniform, for example, the user base station handover data and call signaling of the signaling system are usually based on the International Mobile Subscriber Identity (IMSI, International Mobile Subscriber Identification Number) as the basis for classification and recording; B-domain data is business domain data, for example, data such as bills, customer information, and bills are classified and recorded based on telephone numbers...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 钟全龙赵奇勇林星锦
Owner 中国移动通信集团重庆有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More