Hybrid Query Conversion for Structured Search on Unstructured Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional structured data management applications are unable to leverage unstructured data, such as machine-generated logs, due to the lack of structure, limiting users familiar with these applications from querying and utilizing this valuable information.
Innovation Solution
A mechanism is provided to execute structured queries on unstructured data by converting them into unstructured queries using a pilot query to identify data structure, allowing SDM applications to interact with unstructured data stores and reorganize results into structured format for presentation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional structured data management applications are used, then users can query structured data effectively, but they cannot utilize unstructured data such as machine-generated logs
Solution Approach 1:
A query conversion module acts as an intermediary between SDM applications and unstructured data stores. This module translates structured queries from SDM applications into unstructured queries that can be executed on unstructured data, enabling users familiar with SDM applications to query unstructured data without learning new tools or interfaces
Solution Approach 2:
The system changes the parameter of query structure by converting structured query syntax into unstructured query syntax. The query conversion module transforms queries with fixed structural requirements into flexible queries that can operate on unstructured data while preserving the essential query logic and intent
2Productivity
If unstructured data is stored without structure, then data volume and flexibility are maintained, but querying and managing the data becomes challenging
Solution Approach 1:
The query conversion module serves as a mediator that bridges the gap between structured query capabilities and unstructured data storage. It translates structured queries into unstructured query formats, enabling efficient querying of unstructured data without requiring the data to be pre-structured or organized in specific ways
Solution Approach 2:
Instead of transforming unstructured data into structured format before querying (the conventional approach), the system inverts the process by transforming structured queries into unstructured queries that can directly operate on unstructured data in its native format, preserving storage efficiency while enabling querying
Data Source
AI summary
Technologies are described herein for executing queries expressed with reference to a structured query language against unstructured data. A user issues a structured query through a traditional structured data management (“SDM”) application. Upon receiving the structured query, an SDM driver analyzes the structured query and extracts a data structure from the unstructured data, if necessary. The structured query is then converted to an unstructured query based on the extracted data structure. The converted unstructured query may then be executed against the unstructured data. Results from the query are reorganized into structured data utilizing the extracted data structure and are then presented to the user through the SDM application.


