Future Target Table Pre-creation for Database Loading
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Efficiently loading data into a target database system while minimizing loading time, as existing methods often incur significant overhead in creating target tables on demand, which can lead to inconsistent data access and prolonged processing times.
Innovation Solution
Pre-create a 'future target table' based on a defined schema, allowing for immediate use when a load request is received, and optionally swap roles with a 'current target table' to reduce storage resources and enhance concurrent operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If target tables are created on demand when load requests occur, then the system maintains flexibility and adapts to varying data loading needs, but the data loading time increases due to the overhead of table creation operations
Solution Approach 1:
The patent applies preliminary action by creating future target tables in advance based on predicted data loading requirements, rather than waiting for actual load requests. The system analyzes historical data loading patterns, identifies tables likely to be loaded soon, and pre-creates their target tables with appropriate schemas, thereby eliminating the time-consuming table creation step during actual data loading operations.
2Productivity
If multiple target tables are maintained for different data loading scenarios, then the system can handle concurrent operations efficiently, but the storage resource consumption increases
Solution Approach 1:
The patent implements dynamics by making the target table structure adaptable and reusable. Instead of maintaining separate static tables for each scenario, the system creates flexible target tables that can serve multiple purposes through dynamic schema configuration and reuse mechanisms, allowing the same table infrastructure to support various concurrent data loading operations with different requirements.
Solution Approach 2:
The patent applies universality by designing target tables with multi-functional capabilities. The pre-created target tables are configured to handle multiple data loading scenarios and concurrent operations through universal schema designs that can accommodate varying data types and structures, reducing the need for dedicated tables for each specific loading scenario.
3Reliability
If the system waits for load requests before creating target tables, then storage resources are optimized, but data access consistency deteriorates due to delayed table availability
Solution Approach 1:
The system ensures data access consistency by performing preliminary actions - creating target tables in advance based on predicted loading needs. This pre-creation guarantees that tables are available and consistent when data loading operations commence, eliminating delays and ensuring reliable data access without compromising storage efficiency through intelligent resource allocation.
Data Source
AI summary
The present disclosure relates to a computer implemented method for loading data in a target database system. The method comprises: determining that a load of a source table is expected to occur in the target database system. A future target table may be provided in advance in accordance with a defined table schema, and thereafter a load request for loading the source table may be received. Data of the source table may be loaded into the future target table.