Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Operation data processing method and system

A technology of data processing and data processing device, applied in the field of communication

Active Publication Date: 2014-04-30
中移动信息技术有限公司 +1
View PDF3 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The method and system provide the implementation of streaming computing technology in the technology and architecture of the business analysis system, and are used to solve the problems of real-time business data of unstructured data, real-time analysis of massive data, and data processing efficiency and timeliness. Solve the storage and analysis problems of massive data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Operation data processing method and system
  • Operation data processing method and system
  • Operation data processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] Below in conjunction with accompanying drawing and embodiment the present invention will be further described:

[0034] Such as figure 1 As shown, a flow chart of a method for processing operation data is provided for a preferred embodiment of the present invention. The method comprises the steps of:

[0035] S1: The operation and maintenance management center 5 of the business analysis system determines the data application module of the data application device 4 to be invoked and the data to be obtained by the data acquisition device 1 as required.

[0036]In this embodiment, the data application module of the data application device 4 to be called can be determined according to the actual needs of the operation business, such as real-time marketing business, real-time service business, real-time monitoring business, etc., for various types of business in the data application device 4 are correspondingly provided with corresponding modules, and the operation and mai...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an operation data processing method and system, in particular to an operation data processing method and system based on stream computation and batch computation for a double-engine business analysis system. According to the operation data processing method and system, a stream computation engine (22) is set in a system framework, so that data real-time processing capacity is improved, and a distributed file system (21) and a batch computation engine (24) are integrated based on a data warehouse (23), so that storage and computation of unstructured data and mass data are achieved, big data storage capacity and big data analysis capacity are improved, and the capacity for storing TB-level data and even PB-level data and the capacity for processing big data in a batched mode can be achieved. Meanwhile, due to the fact the data warehouse (23) is adopted for processing structural data, a micro-batch real-time data can be processed with a micro-batch processing method, and thus a real-time data processing mechanism is further perfected.

Description

technical field [0001] The present invention relates to the communication field, and more specifically, to a method and system for processing operation data. Background technique [0002] Existing business analysis systems generally use a single data warehouse to provide data processing capabilities, and use the ETL tools provided by the data warehouse to extract, load and convert data, and then use the data analysis and associated processing capabilities of the data warehouse to meet front-end business needs. The products of traditional data warehouse vendors are based on high-performance data query and analysis based on relational models, mainly dealing with high-performance query and analysis of structured data; mature built-in data mining algorithms, and provide mature reporting tools and data access interfaces, which are currently available in It is widely used in industries with large amounts of data, such as banking and telecommunications. However, with the rapid dev...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/182G06F16/254G06F16/283
Inventor 洪松敖锦蓉何鸿凌舒琴蔡柱昌曹燕
Owner 中移动信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com