Automated Event Data Archiving with Priority Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data management systems face challenges in accessing and storing pertinent data from events of interest due to limited resources, unreliable communication infrastructure, and the need to prioritize data storage, especially in inaccessible or remote locations where data is often deleted or overwritten on a first-in-first-out basis.
Innovation Solution
A method and apparatus for automatically archiving data from a machine monitoring system by temporarily storing data on a first-in-first-out basis, defining primary and secondary events of interest, and sending data associated with primary events to long-term storage, with the ability to overwrite secondary data when storage capacity is reached, ensuring that crucial data is preserved for analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is stored temporarily on a first-in-first-out basis to save resources, then storage costs are reduced, but data associated with events of interest may be deleted before analysts can access it
Solution Approach 1:
The system performs preliminary action by automatically detecting events of interest and pre-archiving associated data in long-term storage before analysts need to access it. The automated event detection and data archiving occurs in the background without waiting for analyst requests, ensuring data is preserved and ready for analysis.
Solution Approach 2:
The system serves itself by implementing automated event detection and data archiving without requiring manual intervention. The monitoring system automatically identifies events of interest, determines which data to preserve, and transfers it to long-term storage independently, freeing analysts from manual data management tasks.
2Loss of information
If all data associated with multiple events of interest is stored in long-term storage, then data availability for analysis is improved, but storage resources are depleted
Solution Approach 1:
The system applies local quality by differentiating between types of data and events, applying different retention policies to different data categories. Critical events receive priority archiving while less important events use available storage capacity, creating a quality-based storage hierarchy rather than uniform treatment of all data.
Solution Approach 2:
The system changes parameters by dynamically adjusting storage allocation based on event priority and storage availability. When storage is full, the system modifies its archiving behavior by selecting which events to archive based on predefined priorities, effectively changing the storage parameter from 'archive all' to 'archive selective'.
3Reliability
If data is archived automatically for primary events of interest, then critical data is preserved, but storage space may be insufficient for secondary events
Solution Approach 1:
The system segments events into different priority levels (primary and secondary events of interest), allowing differentiated storage strategies. Primary events receive guaranteed archiving while secondary events compete for remaining storage space, creating a segmented approach that ensures critical data preservation while maintaining some flexibility for other data.
Data Source
AI summary
A method for detecting an event and/or behavior of interest based on monitoring data and selectively storing portions of the monitoring data associated with the event and/or behavior of interest. Preferably, the method includes defining a hierarchy of event and/or behavior types so that the storing of a first behavior/event type is preferred over a second behavior/event type, especially when storing capacity is scarce. A data management apparatus including a logic device and a long-term storage memory apparatus, the logic device for detecting an event and/or behavior of interest based on monitoring data and selectively storing portions of the monitoring data associated with the event and/or behavior of interest on the long-term memory storage apparatus.