File Browser Interface for Late-Binding Event Search
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Big data systems face challenges in efficiently analyzing and summarizing large volumes of data across disparate platforms, making it difficult to move and process data between systems, and existing solutions like SPLUNK® ENTERPRISE and Hadoop struggle to access and make sense of data from external systems.
Innovation Solution
A search support system allows customers to browse and process data from external storage systems like Hadoop, perform data processing tasks in real time, and save settings as a late binding schema to parse and index timestamped events, with ERP processes handling external data sources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is stored in disparate big data intake and search systems, then data storage capacity is improved, but data analysis and summarization capability deteriorates
Solution Approach 1:
The patent merges data from multiple disparate big data intake and search systems into a unified view, enabling cohesive analysis across distributed data sources while maintaining the storage benefits of multiple systems
Solution Approach 2:
The patent introduces an intermediary layer that connects disparate data systems, allowing data to be analyzed and summarized across different platforms without requiring direct integration or movement of data between systems
2Quantity of substance
If data amount increases over time, then data storage value is improved, but system mobility deteriorates
Solution Approach 1:
The patent extracts data analysis capabilities from the physical data storage locations, allowing data to remain stored in disparate systems while enabling portable analysis tools to access and analyze data across different systems without moving the data itself
3Quantity of substance
If external data sources are accessed, then data comprehensiveness is improved, but data processing complexity deteriorates
Solution Approach 1:
The patent creates a universal data access interface that can handle multiple external data sources through a single cohesive mechanism, reducing processing complexity by providing a unified approach to accessing diverse data sources
Data Source
AI summary
A search support system allows a customer to browse data contained in files stored on an external storage system. The search support system allows a customer to specify data processing tasks to be performed on raw data retrieved from a file stored on the external storage system. The customer specifies each data processing task and the search support system performs each task as it is selected by the customer on raw data retrieved from the file. The search support system concurrently displays the results of each data processing task in real time in a graphical user interface. The search support system saves the customer's settings as a late binding schema that can be applied to raw data retrieved from the external storage system in order to parse the raw data and to create, index, and search timestamped events derived from the raw data.