Database Data Transfer Using Selective Field Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data transfer methods to database systems are inefficient, especially when dealing with large numbers of records that require different treatments, as they often send unnecessary data and lack specificity in distinguishing between extraneous and required data for various operations like insert, update, and delete.
Innovation Solution
A method involving input records with a configurable selector to represent multiple states, allowing only the necessary subset of fields to be transferred to the database system based on the operation, thereby optimizing data transfer by reducing unnecessary data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If all fields are transferred to the database system for every input record, then data completeness is ensured, but data transfer efficiency deteriorates due to transmission of unnecessary extraneous data
Solution Approach 1:
The patent extracts only the necessary fields from each input record based on the operation type indicated by the selector. The transfer agent parses the selector value and selectively transfers only the required fields (e.g., only primary key fields for delete operations, only modified fields for update operations) rather than transferring all fields, thereby eliminating unnecessary data transmission.
Solution Approach 2:
The patent applies different data transfer strategies to different fields within the same input record based on local requirements. Each field is evaluated individually against the operation type, and only fields relevant to that specific operation are transferred. This localized approach optimizes data transfer by tailoring the transferred data to the specific needs of each operation.
2Measurement precision
If a user specifies particular data items to be transferred, then data transfer precision is improved, but device complexity increases due to manual configuration requirements
Solution Approach 1:
The transfer agent automatically determines which fields to transfer by parsing the selector field in each input record. Instead of requiring user configuration, the system self-configures the data transfer process by reading the operation type from the selector and autonomously selecting the appropriate fields based on predefined rules, thereby maintaining precision without increasing complexity.
Solution Approach 2:
The patent uses the selector field as a parameter that changes based on the operation type (insert, update, delete, etc.). By monitoring changes in this parameter, the transfer agent dynamically adjusts which fields are transferred, eliminating the need for manual configuration while maintaining precise control over data transfer.
3Manufacturing precision
If different treatment is applied to different records, then data processing accuracy is improved, but processing time increases due to individual record evaluation
Solution Approach 1:
The patent segments the data transfer process into distinct paths based on the selector value. Different operation types (insert, update, delete) have pre-defined field selection rules, allowing the transfer agent to quickly route each record to the appropriate processing path without complex individual evaluation, thereby maintaining accuracy while minimizing processing time.
Solution Approach 2:
The patent applies a standardized field selection approach for common operation types, using predefined rules that cover the majority of cases. This partial automation handles most records efficiently through pattern matching, while only requiring more detailed processing for exceptional cases, thus balancing accuracy with processing speed.
Data Source
AI summary
A method, computer program, and computer network are disclosed for transferring data to a database system. The method includes preparing a plurality of input records, each including a plurality of fields and a selector configurable to represent a plurality of states. For each input record of the plurality of input records, the following steps are performed. A state represented by the selector for an input record is read. Based on the state represented by the selector, a subset of the fields for the input record is transferred to the database system.