Message Broker System Decouples Data Streams

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current business communication systems face challenges in automating and personalizing data transformation processes, particularly in handling diverse data formats and integrating external data, which limits flexibility and efficiency in processing and delivery.

Innovation Solution

A message broker system that includes an event agent, message broker, and processing engine to transform input data streams from one format to another, allowing for message alteration, concatenation, editing, and mapping, enabling the reuse of processes across different event models and decoupling input and output processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data transformation processes are manually configured for each data format, then processing accuracy is maintained, but system complexity and time consumption increase significantly

Engineering Contradiction:

Improvedata transformation efficiencyVSAvoidtransformation system complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The system enables self-service through automatic format detection and transformation rule generation. The transformation engine automatically identifies input data formats and applies appropriate transformation rules without manual configuration, allowing the system to serve itself in managing diverse data formats.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The transformation engine is designed with universal functionality to handle multiple data formats through a single unified interface. It can process various input formats (XML, JSON, CSV, etc.) and convert them to standardized output formats using the same core transformation mechanisms, eliminating the need for separate processing systems for each format.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple separate processing systems are used for different data formats, then processing reliability is maintained, but system integration complexity increases

Engineering Contradiction:

Improvedata format compatibilityVSAvoidsystem integration complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The transformation engine provides universal adaptability to handle multiple data formats through a single unified system. It supports various input formats including XML, JSON, CSV, and fixed-width formats, and can transform them into standardized output formats using consistent transformation rules, eliminating the need for multiple separate processing systems.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The transformation engine acts as an intermediary between diverse data sources and downstream processing systems. It receives data in various formats, applies standardized transformation rules, and outputs unified formatted data, thereby mediating between format diversity and system integration requirements.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Productivity

If data transformation is performed without standardized formats, then data flexibility is maintained, but processing efficiency decreases

Engineering Contradiction:

Improveprocessing throughputVSAvoiddata format flexibility

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The system performs preliminary action by pre-defining transformation rules and standardized output formats before actual data processing occurs. These transformation rules are configured in advance and stored in the system, enabling rapid automated transformation without requiring real-time format negotiation or manual intervention during processing.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The transformation engine utilizes parameter changes to adapt between different data formats. By modifying transformation parameters and rules based on the detected input format, the system maintains flexibility in handling various formats while achieving efficient standardized output through automated parameter adjustment.

Inventive Principle:

Principle #35Parameter changes

4Reliability

If manual data validation is performed at each processing stage, then data quality is ensured, but processing time increases

Engineering Contradiction:

Improvedata quality assuranceVSAvoidvalidation time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

Data validation is performed continuously throughout the transformation process rather than as separate manual checks at each stage. The transformation engine incorporates validation rules that operate continuously during automated transformation, ensuring data quality is maintained without interrupting the processing flow or requiring manual intervention at each checkpoint.

Inventive Principle:

Principle #20Continuity of useful action

Data Source

PatentUS9237120B2Message broker system and method

Publication Date: 2016.01.12 OPEN TEXT SA ULC

AI summary

A message broker system can include a message broker. The message broker can be configured to receive the message instances output as input message instances, store the input message instances in a message store, alter the structure or content of the input message instances according to a message brokering model to generate output message instances and provide output message instances to one or more downstream processors. According to one embodiment, input message stream processing can be decoupled from output message stream processing by the message broker.