Database Query Signature Verification for Post-Deployment Correctness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing database management systems (DBMS) lack comprehensive validation after deployment, leading to undetected inconsistencies that result in incorrect query results being returned to users, particularly in fast-paced deployment scenarios like cloud-provided services, where resource-constrained environments limit the ability to perform thorough quality checks.

Innovation Solution

A database engine generates signatures for query results using a per-row hash function, storing them in a key-value store for comparison with subsequent executions, and a correctness verifier detects mismatches to generate inconsistency reports and perform remediation, ensuring consistent query results across different versions of the database engine.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If validation testing is performed during software development stages, then manufacturing precision is improved, but further validation cannot be performed after deployment to users

Engineering Contradiction:
Improvevalidation testingVSAvoidpost-deployment validation
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent implements preliminary action by embedding validation mechanisms (signatures and verification logic) into the database engine before deployment. These pre-installed validation components enable continuous post-deployment verification of query results without requiring external testing infrastructure, thus resolving the contradiction between development-stage validation and post-deployment reliability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent establishes a feedback mechanism where query results are continuously verified against stored signatures from previous executions. The verification process provides immediate feedback when inconsistencies are detected, enabling automatic remediation or alerting. This closed-loop feedback system maintains reliability after deployment by continuously validating query correctness without interrupting normal operations.

Inventive Principle:
Principle #23Feedback

2Reliability

If comprehensive validation testing is performed, then reliability is improved, but resource overhead increases in constrained environments

Engineering Contradiction:
Improvequery result correctnessVSAvoidvalidation overhead
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent extracts only the essential validation information (signatures representing query result characteristics) from the full query results. By storing and comparing these condensed signatures rather than complete result sets, the system achieves comprehensive validation with minimal resource overhead, resolving the contradiction between reliability and energy consumption in constrained cloud environments.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the validation parameter from comparing entire query result sets to comparing condensed signatures (hash values or checksums). This parameter transformation reduces the computational and storage resources required for validation while maintaining the ability to detect result inconsistencies, thus improving the reliability-to-overhead ratio in resource-constrained deployments.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If database engine versions are updated in fast-paced deployment scenarios, then productivity is improved, but detection capability of inconsistencies decreases

Engineering Contradiction:
Improvedeployment speedVSAvoidinconsistency detection
Core Design Contradiction:
ProductivityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements preliminary action by pre-computing and storing signatures of query results from baseline database engine versions. When new versions are deployed, these pre-stored signatures enable immediate comparison and validation without requiring re-execution of validation tests, thus supporting fast-paced deployments while maintaining strong inconsistency detection capability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by storing signatures from proven reliable database engine versions and using these copied signatures to validate results from new versions. This approach allows rapid version iteration while maintaining detection capability, as the copied signatures serve as reference standards for comparing against new version outputs without requiring complete re-validation.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12468621B2Automatic correctness validation of database management systems
Publication Date: 2025.11.11 MICROSOFT TECHNOLOGY LICENSING LLC
  • US12468621B2 patent drawing
  • US12468621B2 patent drawing
  • US12468621B2 patent drawing

AI summary

The automatic detection of inconsistencies in a database system is described. A first signature and a second signature are received. The first signature is a signature of a result of a first execution of the query against a database by a first version of database engine program code. The second signature is a signature of a result of a second execution of the query by a second version of the database engine program code. A determination is made of whether the first signature and the second signature match. In response to the first signature and the second signature failing to match, an inconsistency report regarding at least one of the first or second versions of the database engine program code is generated and remediation regarding at least one of the first or second versions of the database engine program code is performed.