Multi-dimensional Data Query via Spatial Subspace Clustering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data query methods are inefficient due to the selection of unnecessary blocks during data analysis, leading to low data query efficiency, as they rely solely on maximum and minimum values in each dimension, causing ineffective reading and analysis of large quantities of blocks.
Innovation Solution
A data query method that utilizes spatial distribution information to identify blocks matching specified data ranges across multiple dimensions, filtering out blocks that do not contain the queried data by determining subspace objects and their corresponding data ranges, thereby reducing unnecessary block selection and improving query speed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the server uses only the maximum value and the minimum value of data in each dimension to select data blocks, then the selection process is simple, but a large quantity of blocks that do not include the to-be-queried data are selected, causing low data query efficiency
Solution Approach 1:
The patent divides each data block into multiple subspace objects based on spatial clustering, where each subspace object represents a specific data range within the block. This segmentation allows the query system to evaluate smaller, more precise units rather than treating entire blocks as atomic units, thereby reducing the number of blocks that need to be read while maintaining simple selection logic.
Solution Approach 2:
The patent introduces a new dimension of granularity by creating subspace objects within blocks. Instead of operating only at the block level, the system now operates at the subspace level, adding a dimensional layer between blocks and individual data points. This enables more precise filtering without increasing the complexity of the selection process.
2Productivity
If spatial distribution information is used to determine blocks meeting data ranges, then data query efficiency is improved by filtering irrelevant blocks, but the system complexity increases due to constructing and maintaining spatial distribution information
Solution Approach 1:
The patent performs spatial clustering and constructs subspace objects during the data loading phase, before any queries are executed. This preliminary action pre-computes the spatial distribution information and stores it in the database catalog, so that during query processing, the system only needs to retrieve and use this pre-computed information without performing complex calculations in real-time.
Solution Approach 2:
The patent introduces subspace objects as an intermediary layer between raw data blocks and query processing. These subspace objects serve as mediators that encapsulate spatial distribution information, allowing the query system to interact with blocks through this intermediate representation rather than directly handling raw block data, thereby simplifying the query process while improving efficiency.
Data Source
AI summary
A data query method includes: receiving a data query request during a data query, where the data query request specifies data ranges in a plurality of dimensions; obtaining spatial distribution information of multi-dimensional data, where the spatial distribution information records data ranges, in each dimension, of a plurality of subspace objects associated with the multi-dimensional data; determining, from the multi-dimensional data based on the spatial distribution information of the multi-dimensional data, a block that meets the data ranges in the plurality of dimensions specified by the data query request; and searching the determined block for data that meets the data ranges in the plurality of dimensions specified by the data query request.


