Stored Procedure Lineage Comparison Across Data Center Environments

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional methods for verifying changes to stored procedures in a data center are time-consuming and lack proof of correctness, leading to potential errors and increased risk with more stored procedures, which can hinder digital transformation.

Innovation Solution

A data processing method and device that enable real-time comparison of table lineage relationships across development, data quality assurance, and production environments by generating and merging directed graphs of stored procedures to create table lineage graphs, and then comparing these graphs to identify differences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional sampling verification is used to verify stored procedure modifications, then the verification process can be completed, but it is time-consuming and cannot prove correctness

Engineering Contradiction:

Improveverification correctnessVSAvoidverification time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces the mechanical sampling verification process with an automated data processing system that uses directed graph generation and comparison algorithms. The system automatically parses stored procedures, generates table lineage directed graphs, and compares differences between environments, eliminating manual sampling and providing complete verification coverage without time constraints

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-verification by automatically comparing table lineage relationships across different environments. The data processing device independently generates directed graphs from stored procedures and identifies discrepancies without requiring external manual verification, enabling the system to prove its own correctness

Inventive Principle:

Principle #25Self-service

2Adaptability or versatility

If more stored procedures are added to the data center, then the data center functionality is enhanced, but the risk of modification increases

Engineering Contradiction:

Improvedata center functionalityVSAvoidmodification safety

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously monitors and compares table lineage relationships between development, data quality assurance, and production environments. When modifications are made to stored procedures, the system automatically detects discrepancies and provides feedback, allowing for corrective action before errors propagate through the system

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system performs preliminary verification by generating and comparing directed graphs before modifications are deployed to production. The data processing device identifies potential issues in advance by comparing table lineage relationships across environments, preventing erroneous modifications from reaching the production system

Inventive Principle:

Principle #10Preliminary action

3Loss of information

If manual error detection by data users is relied upon, then error feedback can be obtained, but wrong data may cause potential and invaluable losses

Engineering Contradiction:

Improveerror detection capabilityVSAvoiddata error impact

Core Design Contradiction:

Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an intermediary data processing system between the stored procedures and the data users. This system automatically verifies table lineage relationships and detects errors before data is used, preventing wrong data from causing harm. The intermediary system acts as a safeguard that eliminates the need for users to manually detect errors

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS20250068149A1Data processing method and data processing device

Publication Date: 2025.02.27 INVENTEC PUDONG TECH CORPOARTION

AI summary

A data processing method applied in a data center is provided. The data processing method includes obtaining stored procedures of a development environment, a data quality assurance system environment and a production environment from the data center, generating table lineage graphs of the development environment, the data quality assurance system environment and the production environment respectively according to the stored procedures of the development environment, the data quality assurance system environment and the production environment, wherein the step including parsing each stored procedure to determine a directed graph of each stored procedure for each environment and merging the directed graphs of all stored procedures in each environment to generate a table lineage graph for each environment, comparing the table lineage graphs of the development environment, the data quality assurance system environment and the production environment to generate a comparison result, and performing a notification function according to the comparison result.