Batch Processor for Bulk Custom Object Property Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Complex data from object-oriented environments requires additional processing to be stored in databases, leading to resource-intensive and time-consuming queries, especially when dealing with non-scalar values that need conversion across multiple database instances.
Innovation Solution
The implementation of a batch processor that operates on a set of data instances rather than individually, using a converter to perform bulk processing and reduce the number of database queries, thereby minimizing overhead and optimizing query execution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If individual processing is used for each data instance, then data conversion accuracy is maintained, but processing time and resource consumption increase significantly
Solution Approach 1:
The patent combines multiple individual data instance conversions into a single batch processing operation. The batch processor collects multiple data instances and processes them together in one database query, merging what would otherwise be separate processing operations. This reduces the number of database queries from N (for N instances) to 1, significantly reducing processing time while maintaining conversion accuracy through the converter's bulk processing capability.
Solution Approach 2:
The patent performs preliminary actions by collecting and buffering multiple data instances before processing. The batch processor accumulates data instances in a buffer until a threshold is reached or a flush event occurs, preparing the data in advance for efficient bulk processing. This preliminary collection phase allows the system to optimize subsequent database interactions by processing multiple instances together rather than individually.
2Loss of information
If multiple database queries are executed for complex data types, then data retrieval completeness is ensured, but resource consumption and overhead increase
Solution Approach 1:
The patent merges multiple database queries into a single batch query operation. Instead of executing separate queries for each data instance, the batch processor consolidates the data retrieval into one query that fetches all required instances simultaneously. This maintains complete data retrieval while reducing database server load, network overhead, and resource consumption associated with multiple separate query executions.
3Productivity
If bulk processing is implemented, then query execution time is reduced, but processing complexity increases
Solution Approach 1:
The patent segments the bulk processing function into distinct modular components: a batch processor that manages data collection and flushing, a converter that handles data transformation, and a data operation that coordinates the overall process. This segmentation allows each component to be independently optimized and maintained, reducing the complexity burden despite the bulk processing capability. The modular architecture makes the system more manageable than a monolithic bulk processing implementation.
Data Source
AI summary
Disclosed herein are system, method, and computer program product embodiments for bulk processing of custom object properties. An embodiment operates by receiving a query on one or more properties of an object class. A column of a database table is determined to correspond to a field of the object class. A set of data is collected from the determined column. The collected data of the determined column corresponding to each of the plurality of instances is converted by executing the one or more operations on the data set. A result set including the converted data as it corresponds to the plurality of instances associated with the query is provided.