Virtual Function Query Operator for Unstructured Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional database management systems are unable to effectively retrieve and analyze unstructured binary data and perform ad-hoc analysis, as they primarily support structured queries and do not efficiently handle unstructured data formats.
Innovation Solution
The system introduces virtual functions that define data retrieval and processing operations, allowing for the transformation of unstructured data from remote sources into structured formats, enabling efficient data retrieval and analysis by utilizing components like MapReduce frameworks and metadata repositories.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional database management systems are used to store and retrieve data, then fast access to structured data is achieved, but the ability to retrieve and analyze unstructured binary data from remote sources is insufficient
Solution Approach 1:
The patent introduces a remote data source interface that acts as an intermediary between the database management system and external unstructured data sources. This interface enables the system to access and retrieve unstructured binary data from remote locations while maintaining the structured query capabilities of the database system, thus resolving the contradiction between handling unstructured data and ensuring reliable data retrieval
2Adaptability or versatility
If remote large-scale data sources are integrated, then data accessibility is improved, but the system cannot perform ad-hoc analysis on unstructured binary data
Solution Approach 1:
The patent transforms unstructured binary data from remote sources into structured formats through parameter changes in the data representation. By converting the data format and structure during the retrieval process, the system enables ad-hoc analysis operations on previously unstructured data while maintaining integration with remote large-scale data sources
3Productivity
If structured queries are supported, then efficient data retrieval is achieved, but retrieval of unstructured binary data and ad-hoc analysis are not supported
Solution Approach 1:
The patent implements a universal query interface that can handle both structured queries for efficient retrieval and ad-hoc analysis operations on unstructured data. The remote data source interface provides multi-functional capabilities, allowing the same system to perform diverse query operations including data retrieval, transformation, and analysis across different data types and sources
Data Source
AI summary
A system includes definition of a remote data source, definition of a virtual function specifying executable job code, a return data format and a data location in the remote data source, reception of a structured language query including the virtual function as a data source, and, in response to the received query, instruction of the remote data source to execute the job code based on data in the data location and return data in the return data format.


