Stream Reasoner System for Data Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems are inefficient in processing data streams due to reliance on large continuous queries and inability to consolidate knowledge from various sources, leading to slow reasoning and limited window management capabilities.
Innovation Solution
A stream reasoner system that processes data streams by converting them into knowledge packets, managing windows based on client requests, and utilizing heterogeneous knowledge sources for holistic reasoning, with the ability to segment queries for parallel execution and support incremental queries.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional systems use large continuous queries for data stream processing, then they can process the data streams, but the reasoning process becomes slow and inefficient
Solution Approach 1:
The patent segments large continuous queries into smaller, manageable query fragments that can be processed independently and in parallel. This segmentation allows the system to process data streams more efficiently by avoiding the bottleneck of single large query execution, thereby reducing reasoning time while maintaining processing capability.
Solution Approach 2:
The system processes queries incrementally and partially, evaluating query fragments as data arrives rather than waiting for complete data sets. This partial action approach enables faster reasoning by producing intermediate results sooner, improving productivity without requiring full data accumulation before processing.
2Ease of operation
If conventional systems consolidate all knowledge at a single location for reasoning, then reasoning can be performed, but the system complexity and difficulty of knowledge integration increase
Solution Approach 1:
The patent extracts the requirement for physical knowledge consolidation by allowing knowledge to remain at its source locations (distributed across multiple systems). The system retrieves and reasons over knowledge remotely without requiring it to be physically consolidated, thereby maintaining reasoning capability while reducing system complexity and integration difficulty.
Solution Approach 2:
The system introduces an intermediary layer (the query processing architecture) that mediates between distributed knowledge sources and reasoning operations. This intermediary enables reasoning over distributed knowledge without requiring direct consolidation, simplifying the overall system architecture while preserving full reasoning functionality.
3Adaptability or versatility
If conventional systems use fixed time-based or count-based windows, then they can manage data streams, but they cannot adapt to client-specific lifetime requirements
Solution Approach 1:
The patent implements dynamic, application-managed windows that can adapt their size and duration based on client-specific requirements and the actual lifetime of facts. This dynamic approach replaces fixed time-based or count-based windows with flexible structures that grow and shrink according to the actual needs of the application, thereby improving both adaptability and the accuracy of fact lifetime management.
Data Source
AI summary
Disclosed is a method and a system for stream reasoning a plurality of data streams. The system comprises a processor and a memory coupled to the processor. The processor is capable of executing a plurality of modules embodied on the memory. The plurality of modules comprises an event module and a application managed window module. The event module is configured to receive a data stream associated with an event from a stream reasoner application. The data stream provides factual information about the event. Further, the data stream comprises a request. The request may be an add request or a delete request. The application managed window module is configured to insert the request associated with the event or delete a prior request associated with the event from the memory based upon a type of the request.