Data Processing Flags for Dynamic Range Queries
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing systems face inefficiencies when executing new queries that require changing the range of processing target data, as they often need to re-input records that have been previously deleted to improve memory utilization, leading to increased processing load and prolonged times.
Innovation Solution
The system introduces flags for each item to dynamically establish and manage data processing windows, allowing for the execution of new queries by identifying start and end flags within the data range, enabling the processing of data without the need to re-input records.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If records are deleted from memory after data processing to improve memory utilization efficiency, then memory utilization efficiency is improved, but when a new query requires processing previously deleted records, the processing apparatus must re-input the records, causing increased processing load and prolonged processing time
Solution Approach 1:
The patent applies preliminary action by maintaining a history log that pre-stores information about processed records before they are deleted from memory. This history log contains essential record identifiers and processing results, allowing the system to quickly retrieve and re-process records without re-inputting them when new queries are received, thus avoiding the need to re-input deleted records and reducing processing time
2Productivity
If records are kept in memory to avoid re-inputting for new queries, then processing time for new queries is reduced, but memory utilization efficiency deteriorates due to increased memory occupation
Solution Approach 1:
The patent extracts only the essential information needed for quick re-processing from the full records. The history log stores compact record identifiers, range information, and key processing results rather than complete record data. This extraction approach allows the system to maintain quick access to processing information while occupying minimal memory space, thus improving processing speed without significantly increasing memory usage
3Adaptability or versatility
If the processing apparatus re-inputs deleted records to execute new queries, then the range of processing target data can be changed, but processing load increases due to searching and inputting operations
Solution Approach 1:
The patent introduces a history log as an intermediary between the memory system and the processing unit. When new queries are received, the system first checks the history log for matching record ranges using the range identification unit. If matches are found, the system directly retrieves processing information from the history log without needing to search original records or re-input data, thus reducing processing load while maintaining query flexibility
Data Source
AI summary
A data processing method includes steps of; allowing establishment of a first flag or a second flag for each of a plurality of items where corresponding values are inputted sequentially; upon detecting that a value associated with an item where the first flag is established in an Nth place is inputted and that a value associated with an item where the second flag is established in an Mth place (M is equal to or larger than N) is inputted, executing a predetermined processing to values in a range from the value that is inputted by associating with the item where the first flag is established in the Nth place to the value that is inputted by associating with the item where the second flag is established in the Mth place; and executing a processing of outputting a processed result in order from the item in the Nth place.