System and method for distributed multi-stage persistence of huge number of messages

A distributed, multi-stage technology, applied in transmission systems, special data processing applications, instruments, etc., can solve problems such as large impact, low database performance, and impact on message processing platform performance, and achieve the effect of performance improvement

Active Publication Date: 2014-02-26
上海普坤信息科技有限公司
View PDF6 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] This direct persistence method is greatly affected by external conditions such as the database
If the perf

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for distributed multi-stage persistence of huge number of messages
  • System and method for distributed multi-stage persistence of huge number of messages
  • System and method for distributed multi-stage persistence of huge number of messages

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] In order to describe the technical content of the present invention more clearly, further description will be given below in conjunction with specific embodiments.

[0045] The principle of synchronous call to achieve message persistence is as follows: image 3 shown.

[0046] The service bus agent is responsible for saving the original record of each service call of the message processing platform, and each call includes four records 1, 2, 3, and 4. Agent adopts read-write separation technology to ensure that the read-write of log files does not conflict.

[0047] The log receiving engine of the service call monitoring system (SMS, Service call monitoring system). Automatically search for log files in the directory specified by Service Bus. After the file is read, store the logs one by one in the SMS local disk. After the log is stored, the log receiving engine deletes the log file on the service bus and reads the next log file.

[0048] The log analysis engine of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and system for distributed multi-stage persistence of a huge number of messages. The system comprises a service bus proxy, a service call monitoring subsystem, a log analysis engine and a log storage engine, wherein the service bus proxy is used for storing asynchronous request messages received by a message processing platform in an asynchronous message queue; the service call monitoring subsystem comprises a log receiving engine for receiving log files sent by an asynchronous message sending process; the log analysis engine is used for combining and analyzing the log files; the log storage engine is used for storing statistical information and message information processed by the log analysis engine. By adopting the method and the system with the structure for distributed multi-stage persistence of a huge number of messages, persistent asynchronous storage and persistent distributed storage can be realized by borrowing ideas from asynchronous and distributed file systems, and the performance of the message processing platform is greatly improved through multi-stage persistence, so that the method and the system have wider application ranges.

Description

technical field [0001] The present invention relates to the field of message processing platforms, in particular to the field of message processing on message processing platforms, and specifically refers to a system and method for distributed multi-stage persistence of massive messages. Background technique [0002] The message processing platform provides the most basic connection center in the network and is a necessary element to build the nervous system of the enterprise. It eliminates the technical differences between different applications, allows different application servers to operate in coordination, and realizes the communication and integration between different services. [0003] Any call on the message processing platform will generate four records 1, 2, 3, and 4 on the platform, see figure 1 4 points marked. The message processing platform serves as the central bus for enterprise service connections, and the statistical information and message information of...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F17/30
Inventor 刘正云
Owner 上海普坤信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap