Distributed type performance data processing method

A technology of data processing and processing methods, applied in the fields of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of increasing software costs, emerging efficiency problems, and large processing pressure on ORACLE databases, and achieves improved efficiency and improved Effects of Accessibility

Active Publication Date: 2014-06-11
INSPUR TIANYUAN COMM INFORMATION SYST CO LTD
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the summary of performance files and the warehousing rely heavily on ORACLE. With the continuous increase of data volume, the p...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed type performance data processing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The present invention will be described in detail below with reference to the accompanying drawings.

[0020] A kind of distributed performance data processing method of the present invention is to use HADOOP, HBASE open-source software distributed storage performance file and adopt STORM scheduling framework, parallel summary calculation, the summary calculation result is entered into ORACLE database; Concrete steps are as follows:

[0021] 1) Introduce the open source distributed file system HADOOP and HBASE software, and split the performance data files into small files with large network element entities as the unit through HBASE and store them in HADOOP;

[0022] 2) The summary calculation of performance data takes files from HADOOP through HBASE, and calculates them in the JAVA program;

[0023] 3) Introducing concurrent processing, the storm master node performs unified scheduling, assigns tasks to different worker nodes for summary calculation, and improves proc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed type performance data processing method based on computing processing of distribution type stored data, and relates to storage and computing processing of network performance large data. A performance data file is stored and managed in a distributed manner through an HBASE and an HADOOP; meanwhile, missions are distributed to a plurality of worker nodes by using a STORM scheduling framework; concurrent computing and storage can be carried out; the entire treatment time is shortened by improving concurrence, so that the dependence on ORACLE is reduced, and the software cost is reduced.

Description

technical field [0001] The present invention relates to the technical field of mobile communication, in particular to a distributed performance data processing method. Background technique [0002] In mobile communication, the performance management system collects and analyzes the operation data of the network management system. It has the ability to collect, analyze, summarize, and store network management data, provide front-end report query, and model management. [0003] However, the collection and warehousing of performance files rely heavily on ORACLE. With the continuous increase of data volume, the processing pressure of ORACLE database is greater, and the efficiency problem is highlighted. At the same time, ORACLE also increases the software cost. Contents of the invention [0004] The purpose of the present invention is to provide a distributed performance data processing method. [0005] The purpose of the present invention is achieved in the following manner...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F9/46
CPCG06F16/13G06F16/182
Inventor 晏学义陈学庆刘金海史守斌
Owner INSPUR TIANYUAN COMM INFORMATION SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap