System and method for message processing and routing

Abstract

A message routing system that allows applications at either end of the system to run as-is without modification. The system functions in a multithreaded environment and is capable of handling complex routing rules and message transformation. It is also capable of learning and executing new routing rules and message transformations in formats previously unrecognized by the system. The system enables precise and reliable logging of messages throughout processing and supports publication of enterprise-wide broadcast messages. The system further preferably employs cooperating inbound and outbound transport processes for consuming, routing, processing, safely storing and publishing messages in batches of logical units of work to ensure that the logical units of work are not lost in system transactions. The system also preferably utilizes a replay server for preserving and replaying messages that might otherwise fail to reach their intended destinations.

Description

FIELD OF THE INVENTION [0001] The present invention relates to a messaging system and method for processing and routing messages in a computer network environment. BACKGROUND OF THE INVENTION [0002] In a computing environment where large amounts of data are moved between various locations, for example in connection with stock trading, it is desirable to move the data as efficiently as possible. One early method for doing so, as illustrated in FIG. 1, was to transfer the data from a main data source 100 as a whole data file 102 via File Transfer Protocol (FTP) to routers 110, 112, 114 located in different areas where the data would need to be distributed. (The geographic locations noted in FIG. 1 are for illustrative purposes only, to show how widely dispersed the data destinations may be.) [0003] Each of the routers 110, 112, 114 contains a local network file server that parses the data file 102 and generates a plurality of smaller data files 116, which are distributed to local dest...

AI Technical Summary

Benefits of technology

[0023] The present invention provides an efficient routing system and method that runs in any publish-subscribe or point-to-point messaging environment regardless of the specifics of the messaging platform and that allows applications at either end of the routing system to run as-is without modification. The system functions in a multithreaded environment and is capable of handling complex routing rules and message transformation. It is also capable of learning and executing new routing rules and message transformations that may be required by new users of the system whose message consumption requirements may be in formats previously unrecognized by the system. The system enables precise and reliable logging of messages throughout processing and supports publication of enterprise-wide broadcast messages. The system further preferably employs cooperating inbound and outbound transport processes for consuming, routing, processing, safely storing and publishing messages in batches of logical units of work to ensure that the logical units of work are not lost in system transactions. The system also preferably utilizes a replay server for preserving and replaying messages that might otherwise fail to reach their intended destinations because of router or application error or failure.

Problems solved by technology

There are two major disadvantages to the arrangement shown in FIG. 1.

First, the data is not sent in real time, leading to an undesired delay in processing the data.

Second, the entire data file 102 had to be sent to multiple locations 110, 112, 114 in order to be distributed to the ultimate destinations 120a-124b, resulting in large amounts of unnecessary computer network traffic.

Because of these disadvantages, the data file 102 was actually parsed and divided multiple times, as opposed to as few as once, thereby creating a process that was inefficient, processor intensive, and not in real time.

One disadvantage of this use of the messaging platform is that there are multiple instances of routers operating at the same time, which creates management issues of having to coordinate several pieces of software.

Furthermore, each router is only able to apply one routing rule.

To apply multiple routing rules to one message, multiple routers need to be arranged in sequence, necessarily creating a complicated network design.

While the architecture of this system permits flexibility in system construction, it requires a significant amount of work by the user to properly construct the system.

This system does not support a publish-subscribe messaging platform, and any application desiring to receive messages must actively seek out new messages.

Following these steps for each application to be connected is both labor-intensive and time-intensive.

While these patents address various problems existing in the prior art, none contemplate use of a single application to handle all of the routing, allowing the applications at either end of a publish-subscribe or a point-to-point messaging system to run as-is without modification, and to run in any messaging environment regardless of the specifics of the messaging platform (i.e., to be messaging system agnostic).

Images