A front-end system for mass data interaction based on distributed message queues

A message queue and front-end system technology, which is applied in the field of front-end systems based on distributed message queues for massive data interaction, can solve problems such as lack of data receiving and sending, bottlenecks in processing capabilities, and inability to expand processing capabilities

Active Publication Date: 2021-07-06
STATE GRID ZHEJIANG ELECTRIC POWER +2
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The original system of the front-end system lacks a unified data caching mechanism for receiving and sending data, so there will be a bottleneck in processing capacity when processing massive data, and it is impossible to simply expand the processing capacity by adding processing nodes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A front-end system for mass data interaction based on distributed message queues

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] The technical solution of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0017] like figure 1 As shown, this technical solution includes a communication gateway cluster for maintaining various communication channel links of field terminals, a front-end processor connected to the communication gateway cluster for message sending and receiving scheduling, and a data processing unit connected to the front-end processor. A message queue cluster for queue processing; the message queue cluster is connected to the application cluster and the data layer, and the message queue cluster plays the role of a data bus inside the front-end system, and the uplink and downlink data are first inserted into the distributed message queue, and each processing node Obtain a corresponding amount of data from the message queue for processing according to its own processing capabilities.

[0018] Wherein, the communication gatew...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A front-end system for exchanging massive data based on a distributed message queue relates to a front-end system. The original system of the front-end processor lacks a unified data caching mechanism for receiving and sending data, and there will be a processing capacity bottleneck when processing massive data. The present invention includes a communication gateway cluster used for maintaining various communication channel links of field terminals, a front-end processor connected to the communication gateway cluster for dispatching and dispatching messages, and a queue-processed message queue connected to the front-end processor. Queue cluster; the message queue cluster is connected to the application cluster and the data layer. The message queue cluster acts as a data bus inside the front-end system. Uplink and downlink data are first inserted into the distributed message queue. Get the corresponding amount of data for processing. The technical solution solves the caching problem of massive data and the linear expansion problem of the processing capability of the front-end system, avoids data loss, and enhances the load balancing capability of the front-end system.

Description

technical field [0001] The invention relates to a front-end system, in particular to a front-end system for mass data interaction based on a distributed message queue. Background technique [0002] The number of collection terminals of the electricity collection system in Zhejiang Province has reached more than 3 million, and the number of collection users has reached more than 25 million. Every day, the peak value of downlink request data and terminal uplink data generated by the main station and background applications will exceed hundreds of millions. The original system of the front-end processor passively receives such huge downlink request data, so it is necessary to control the maximum value of the queue inside each node program. In order to avoid memory overflow exceeding the processing capacity of the program, it can only be selectively discarded; When a system receives a large amount of upstream data that exceeds the processing capacity of the program, it will adop...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L12/66H04L29/06H04L29/08G06F9/54
CPCH04L12/66H04L63/10H04L67/1004H04L67/1097G06F9/544G06F9/546H04L67/568
Inventor 裴旭斌蒋鸿城裘炜浩蒋锦霞方舟杨杰叶方彬王明
Owner STATE GRID ZHEJIANG ELECTRIC POWER
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap