Pluggable component data aggregation system and aggregation method based on multiple systems

A data aggregation and plug-in technology, applied in the field of data processing, to achieve the effects of simplified technology access, support for scalability, and simple implementation conditions

Pending Publication Date: 2020-10-09
国家电网有限公司客户服务中心
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Purpose of the invention: Aiming at the problem of solving business data under different protocols under multi-service systems in a complex environment, the first purpose of the invention is to provide a pluggable component data aggregation system under multiple systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pluggable component data aggregation system and aggregation method based on multiple systems
  • Pluggable component data aggregation system and aggregation method based on multiple systems
  • Pluggable component data aggregation system and aggregation method based on multiple systems

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] Such as figure 1 and figure 2 As shown, a data aggregation method based on pluggable components under multiple systems provided by the present invention, the specific steps are as follows:

[0033] Firstly, gather the data of the collected business systems according to business requirements. First, adapt the data at the collected end, and use the existing aggregator as the data adaptation condition to adapt the data structure. The collected business system data aggregator gathers the business system data through the aggregator and performs structure by the data converter. The structured data is converted to form structured json data, and then the structured data is stored in the memory message middleware by the message middleware, and then the consumption processor calls the structured data for consumption processing.

[0034] Among them, the collection aggregator adopts microservices of microservice architecture, specifically including using Java language and its da...

Embodiment 2

[0049] Embodiment 2 is a schematic diagram of a system implemented based on the system architecture of the present invention, and a schematic diagram of its framework structure, as shown in Figure 4 shown. The aggregation system accesses the collected system. For example, the data source of the business system can be accessed by multiple groups, and then automatically adapts to the aggregator through the data adapter. For example, the source data of the business system is automatically adapted to the corresponding aggregator. Other data sources In the same way as this method, the data packets gathered by the aggregator are converted through the intermediate data converter to form json data, and then the structured data processor forms the json data into structured data, and pushes the formatted data to the message middleware , and then the consumer processor communicates with the message middleware, consumes the data in the message middleware, and pushes the consumed data to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a pluggable component data aggregation system and aggregation method based on multiple systems. According to the method, a convergence collector of a data convergence system isused to be adaptive to multiple data sources, multiple protocols and multiple interface data sources. A target data source is collected through a hot-pluggable convergence model device, collected data is converted into standard structured data through an intermediate data model conversion layer, data streams are stored in message middleware, and then the data streams are called from the message middleware to be analyzed and processed. The method does not need to collect the target data in modes such as code modification and plug-in addition in the collected service system, does not sense thecollected service system, has no performance influence and interference on the collection system, is quick in deployment, is simple in implementation condition, and is compatible with various operation systems and various system platforms.

Description

technical field [0001] The present invention relates to the data processing technology of multiple data sources under various protocols, how to adapt different data sources under multiple systems, and the aggregation method of different structures, and specifically relates to a data aggregation system and aggregation method based on pluggable components under multiple systems . Background technique [0002] At present, the adaptation of data sources in enterprise big data analysis applications or Internet data applications requires one-to-one customized development for adaptation, which consumes a lot of time and workload. In order to solve multiple data sources in enterprise and Internet applications How to automatically adapt the aggregation technology and method for accessing and running data, especially for data collection and aggregation of data sources in multi-service systems. Currently, customized development is usually used in the market to connect and adapt differe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F9/54
CPCG06F16/252G06F16/258G06F9/546G06F2209/548G06F2209/547
Inventor 邓志东刘旭生孙林檀李子乾唐振营杨自兴徐胤杨睿
Owner 国家电网有限公司客户服务中心
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap