Metric Definition Interface for Search-Derived Asset Hierarchies
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Analyzing and searching massive quantities of machine-generated data from diverse sources is challenging due to the complexity and volume of data types and formats, requiring efficient processing and storage solutions to derive insights effectively.
Innovation Solution
The implementation of a data intake and query system, such as the SPLUNK ENTERPRISE system, which uses a late-binding schema to process and store machine data, allowing flexible schema definition and extraction rules for field values during search time, enabling the analysis of minimally processed data across disparate data sources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If traditional data processing systems are used to handle massive machine-generated data from diverse sources, then data storage and basic processing can be achieved, but the complexity of processing and analyzing data across different formats and sources increases significantly
Solution Approach 1:
The patent segments the data processing system into distinct functional modules: data intake components that collect raw machine data, indexing components that organize data by extracted fields, and search components that query indexed data. This segmentation allows each module to handle specific tasks efficiently, reducing overall system complexity while managing massive data volumes from diverse sources
Solution Approach 2:
The patent introduces an intermediary indexing layer that sits between raw data storage and query processing. This indexing mechanism extracts key fields from unstructured machine data and creates structured indexes, serving as a mediator that simplifies subsequent search operations without requiring complex processing of the entire raw data set
2Loss of energy
If data is minimally processed and stored in raw format, then storage efficiency is improved, but the ability to analyze and extract insights from the data deteriorates
Solution Approach 1:
The patent performs preliminary field extraction and indexing operations on incoming machine data before it needs to be analyzed. By pre-processing data to extract relevant fields and create indexes during the data intake phase, the system maintains storage efficiency while ensuring data is ready for rapid analysis when needed, without requiring full processing of raw data during query operations
3Adaptability or versatility
If flexible schema definition is implemented to accommodate diverse data formats, then adaptability to different data sources is improved, but the complexity of schema management and field extraction increases
Solution Approach 1:
The patent implements a dynamic schema approach where field extraction rules and data models can be configured and modified without requiring system reconfiguration. The system adapts to different data formats through configurable extraction patterns that can be added, removed, or modified independently, allowing flexible schema management while maintaining operational simplicity
Data Source
AI summary
An example method of implementing a control interface for metric definition specification for asset-driven hierarchy includes: causing display of a user interface for configuring a metric definition for a metric of an asset node of the asset hierarchy; receiving, via the user interface, a metric determination specification comprising an identification of a metric component, an identification of an operation to apply to the metric component, and metric time factors corresponding to time-related aspects of the metric definition; and reflecting, in a computer storage, the metric definition comprising an association of the metric determination specification with the metric.