Field Sidebar Interaction for Event-Level Search Field Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern data centers discard raw performance data during pre-processing, making it impossible to analyze unforeseen data items post-ingestion, limiting flexibility and analysis capabilities.
Innovation Solution
Implement an event-based system with a late-binding schema that allows data storage and analysis at search time, enabling flexible schema development and extraction rules to handle unstructured data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If raw performance data is discarded during pre-processing, then data storage efficiency is improved, but analysis flexibility is worsened
Solution Approach 1:
The system performs preliminary indexing of raw performance data during the data ingestion phase, creating a searchable structure that enables both efficient storage and flexible analysis. The raw data is indexed with metadata and stored in a manner that allows rapid retrieval without requiring full raw data retention, thus achieving both storage efficiency and analysis flexibility.
Solution Approach 2:
The patent introduces an intermediary indexing layer between raw data ingestion and analysis. This indexing mechanism acts as a mediator that enables efficient data retrieval and flexible analysis without requiring the retention of complete raw data sets. The index structure allows the system to answer analytical queries about raw performance data while maintaining storage efficiency.
2Productivity
If pre-specified data items are extracted during data ingestion, then retrieval efficiency is improved, but analysis capability for unforeseen items is worsened
Solution Approach 1:
The system employs dynamic field extraction where the set of extracted data items is not fixed but can be adapted based on analysis needs. The indexing mechanism allows for dynamic addition of new field extraction rules without requiring system reconfiguration, enabling both efficient retrieval of pre-specified items and flexible analysis of unforeseen data items.
Solution Approach 2:
The patent creates a universal indexing structure that serves multiple functions: it enables efficient retrieval of pre-specified data items, supports flexible analysis of unforeseen items, and allows dynamic adaptation to new analysis requirements. This multi-functional index structure replaces the need for separate optimization mechanisms for different analysis scenarios.
3Loss of time
If data is pre-processed based on anticipated needs, then analysis speed is improved, but adaptability to new analysis requirements is worsened
Solution Approach 1:
The system performs preliminary indexing of raw performance data during the data ingestion phase, creating a searchable structure that enables both efficient storage and flexible analysis. The raw data is indexed with metadata and stored in a manner that allows rapid retrieval without requiring full raw data retention, thus achieving both storage efficiency and analysis flexibility.
Solution Approach 2:
The system employs dynamic field extraction where the set of extracted data items is not fixed but can be adapted based on analysis needs. The indexing mechanism allows for dynamic addition of new field extraction rules without requiring system reconfiguration, enabling both efficient retrieval of pre-specified items and flexible analysis of unforeseen data items.
Data Source
AI summary
An event limited field picker for a search user interface is described. In one or more implementations, a service may operate to collect and store data as events each of which includes a portion of the data correlated with a point in time. Clients may use a search user interface perform searches by input of search criteria. Responsive to receiving search criteria, the service may operate to apply a late binding schema to extract events that match the search criteria and provide search results for display via the search user interface. The search user interface exposes an event limited field picker operable to make selections of fields with respect to individual events in a view of the search results. In response to receiving an indication of a fields selected via the picker, visibility of selected fields may be updated to control which field and values are included in different views.


