Data Association Query Policy for Distributed Engine Efficiency

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing data association query methods consume significant resources and time due to the processing of large amounts of data.

Innovation Solution

A data association query method and apparatus that parses a data query statement to obtain association query information, determines a query policy based on the query key information, and queries data in a second association table according to the query policy, thereby reducing the amount of data processed and improving query efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional association query methods are used to query data in distributed data processing engines, then comprehensive data retrieval is achieved, but significant resources and time are consumed due to processing large amounts of data

Engineering Contradiction:

Improvedata retrieval completenessVSAvoidquery execution time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the association query process into distinct phases: parsing the query statement to extract query key information, determining a query policy based on the query key information, and executing the query according to the determined policy. This segmentation allows for optimized processing at each stage, reducing overall query time while maintaining retrieval completeness

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by parsing the query statement in advance to extract query key information from the first association table before executing the actual data retrieval. The query policy is determined beforehand based on this extracted information, enabling more efficient and targeted data retrieval from the second association table, thus reducing the time consumed during the actual query execution

Inventive Principle:

Principle #10Preliminary action

2Reliability

If traditional association query methods process all data in association tables, then accurate query results are obtained, but the amount of data processed increases resource consumption

Engineering Contradiction:

Improvequery result accuracyVSAvoidprocessing resource consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent extracts only the necessary query key information from the query statement and the first association table, rather than processing all data in the association tables. By determining a query policy based on this extracted key information, the system retrieves only the relevant data from the second association table, ensuring accurate query results while significantly reducing the amount of data processed and the associated resource consumption

Inventive Principle:

Principle #2Taking out (Extraction)

Data Source

PatentUS12216655B2Data association query method and apparatus, device, and storage medium

Publication Date: 2025.02.04 ZTE CORP

AI summary

Provided are a data association query method and apparatus, a device, and a storage medium. The data association query method includes the following: parsing a data query statement to obtain association query information, where the association query information includes query key information of a first association table; determining a query policy according to the query key information, where the query policy includes a partition filtering policy, a scan-while-filter policy and a scan-before-filter policy; and querying data in a second association table based on the query policy.