Information Processing Apparatus for Time-Series Data Sorting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for processing time-series data, such as those handled by computers, face challenges in maintaining the correct order of records due to clock deviations and network delays, leading to inefficiencies in storage and retrieval, especially when data is written and read from hard disks or semiconductor memory.
Innovation Solution
An information processing apparatus with multiple storage areas that prioritize data based on their order of receipt, allowing for quick and accurate sorting by using a receiving unit, comparing unit, and writing unit to determine the appropriate storage area for new data based on their processing order, and a merging unit for sequential access to maintain data order.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If records are stored with indexes attached thereto as described in Non-Patent Document 1, then the order of reception problem is solved, but the processing speed is degraded due to two-step random access
Solution Approach 1:
The patent segments data into multiple streams and stores them in separate storage areas, allowing each stream to be processed independently with sequential access, thus avoiding the random access bottleneck while maintaining correct ordering within each stream
Solution Approach 2:
The patent performs preliminary sorting of data into appropriate storage areas based on arrival time before final processing, enabling sequential access during retrieval without requiring index-based random access operations
2Reliability
If data are written to hard disk with indexes attached thereto, then two-step access including seeking occurs which is slow, but data can be retrieved with correct order
Solution Approach 1:
The patent maintains continuous sequential access operations by organizing data storage and retrieval to avoid seeking operations, ensuring that the magnetic head or cache continues to access data in a continuous manner without interruption or repositioning
3Reliability
If time-series data are sorted in memory and then written to hard disk in order of time stamp, then correct order is achieved, but it is impossible to cope with large clock deviations and network delays
Solution Approach 1:
The patent dynamically assigns data to different storage areas based on arrival time and stream identification, allowing the system to adapt to varying network conditions and clock deviations without requiring predetermined sorting in memory
Data Source
AI summary
An information processing apparatus includes: a storage unit having a plurality of storage areas which holds storage data including main body data and order data according to the writing order of the storage data, a receiving unit respectively receiving a plurality of reception data including the main body data and the order data, a comparing unit determining whether or not to write the reception data to the storage area on the basis of a result obtained by comparing the order data included in one or a plurality of storage data from the last in the storage area with the order data included in the reception data received by the receiving unit, and a writing unit writing the reception data to the storage area as the storage data in accordance with the determination made by the comparing unit.