Incremental Version Control for Consistent Data Package Loading
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing solutions lack a method to ensure consistency between data versions and data package versions during the loading process, which is crucial for maintaining accuracy and relevance in product operation services.
Innovation Solution
A version control method and apparatus that performs incremental processing on data package versions to obtain an incremental version, loads data into item tables based on item identifiers, and uses the incremental version as the data package version to ensure consistency between data versions and package versions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If version control is performed on data during the loading process, then the consistency between data version and data package version is ensured, but the complexity of the data loading process increases
Solution Approach 1:
The patent performs incremental processing on the data package version to obtain an incremental version before completing the data loading. This preliminary version update ensures that when data is loaded into item tables, the version consistency is pre-established, avoiding the need for complex post-loading version reconciliation processes.
Solution Approach 2:
The patent uses the incremental version as both the data version for loaded data and the data package version, creating a feedback mechanism where the version information is continuously updated and verified throughout the loading process. This ensures consistency without requiring separate verification steps.
2Reliability
If incremental processing is performed on data package version, then the version consistency is maintained, but the processing time increases
Solution Approach 1:
Instead of performing complete version processing on the entire data package, the patent applies incremental processing that only updates the necessary version information. This partial action approach maintains version consistency while minimizing the additional processing time required.
Solution Approach 2:
The patent changes the state of the version parameter from a static data package version to a dynamic incremental version that is updated progressively during loading. This parameter transformation allows version tracking without the overhead of complete version recalculation.
Data Source
AI summary
The present disclosure provides a version control method and apparatus, an electronic device, and a storage medium. The version control method includes: in response to a data loading instruction, obtaining a plurality of pieces of data to be loaded, a data package corresponding to the plurality of pieces of data to be loaded, and a data package version of the data package; performing incremental processing on the data package version to obtain an incremental version; loading, for each piece of data to be loaded based on an item to be loaded that corresponds to the data to be loaded, the data to be loaded into an item table corresponding to the item to be loaded among at least one item table, to obtain loaded data, using the incremental version as a data version of the loaded data; and using the incremental version as the data package version.