Cluster Processing System for Transaction Report Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Ingesting and processing large data sets for report generation in transaction systems is time-consuming and resource-intensive, making it impractical, especially when multiple reports are requested with their own large data sets.
Innovation Solution
A system utilizing a cluster processing system to ingest, store, and process data, which includes a processor for managing data ingestion, security definitions, and transformation definitions, allowing for efficient data processing and report generation, even with large data sets, by providing extended functionality to transaction servers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If large data sets are ingested into the transaction system for processing, then complete report generation is achieved, but considerable time and significant memory resources are consumed
Solution Approach 1:
The patent divides the transaction system into two distinct parts: a transaction server for handling transactions and a separate cluster system for processing large data sets. This segmentation allows report generation to occur in the cluster system without blocking transaction processing, thus reducing the time impact on overall system operation while maintaining complete report generation capability.
Solution Approach 2:
The patent introduces a cluster system as an intermediary between the transaction server and the reporting process. The cluster system receives data from the transaction server, processes large data sets for reports, and returns results. This intermediary approach allows the transaction server to offload time-consuming reporting tasks, reducing memory resource consumption and time loss while ensuring complete report generation.
2Reliability
If large data sets are ingested into the transaction system for processing, then complete report generation is achieved, but significant memory resources are consumed
Solution Approach 1:
The patent segments the system architecture to separate memory-intensive reporting operations from the transaction server. The cluster system, with its own dedicated memory resources, handles large data set processing while the transaction server maintains its memory resources for transaction processing. This segmentation enables complete report generation without consuming the transaction server's memory resources.
Solution Approach 2:
The cluster system acts as an intermediary that provides dedicated memory resources for processing large data sets. By moving data ingestion and processing to the cluster system, the patent eliminates the need for the transaction server to allocate significant memory resources for reporting, while still achieving complete report generation through the cluster's processing capabilities.
3Adaptability or versatility
If multiple reports are requested each with their own large data sets, then comprehensive reporting is achieved, but processing time becomes excessively long
Solution Approach 1:
The patent segments reporting tasks into independent units that can be processed concurrently in the cluster system. Each report request is handled as a separate processing job in the cluster, allowing multiple reports to be generated simultaneously without blocking each other. This segmentation enables comprehensive reporting capability while reducing total processing time through parallel execution.
Solution Approach 2:
The patent implements preliminary actions by pre-processing and preparing data in the cluster system before report generation is requested. The cluster system can pre-ingest and prepare large data sets, so when multiple report requests arrive, the processing time is reduced because the data is already available in the cluster. This preliminary action enables comprehensive reporting while minimizing processing time delays.
Data Source
AI summary
A system for reporting for a transaction server using cluster stored and processed data. The system comprises a processor and an interface. The processor is to cause ingestion of data from an ingestion source on a cluster system and store a security definition and a transformation definition for one or more data sources that are derived from the data from the ingestion source. The security definition includes a tenant associated with each data source of the one or more data sources. The processor is further to cause execution of cluster processing associated with a report using the one or more data sources and based at least in part on a determination of authorization using the security definitions to produce an output of the cluster processing and generate a report using a transaction server process and the output of the cluster processing. The interface is to provide the report.