Communication Data Compression Selection for Fast Low-RAM Recording
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Low-performance terminal apparatuses with limited RAM capacity and slow access speeds struggle to efficiently accumulate communication data, leading to longer accumulation times than data transfer to a central apparatus, hindering effective data aggregation.
Innovation Solution
A data processing apparatus that selects an optimal data compression method based on compression and decompression speeds to record and retrieve communication data, ensuring efficient storage and processing, even on low-performance devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If communication data is accumulated in internal storage apparatus of low-performance terminal apparatus, then data can be stored, but accumulation time becomes longer than data transfer time to center apparatus
Solution Approach 1:
The patent extracts only the necessary portion of communication data (header information and control information) for accumulation in internal storage, while outsourcing the storage of full packet data to external storage apparatus. This selective extraction enables low-performance terminal apparatus to maintain data accumulation functionality without being bottlenecked by limited internal storage capacity and slow processing speed.
Solution Approach 2:
The patent introduces an external storage apparatus as an intermediary between the terminal apparatus and the center apparatus. This intermediary handles the storage burden, allowing the terminal apparatus to focus on data collection and transmission without being constrained by its own storage limitations, thereby reducing accumulation time.
2Quantity of substance
If data compression method is selected based on high compression rate, then storage efficiency is improved, but decompression time increases
Solution Approach 1:
The patent applies different compression methods to different portions of data based on their characteristics. Header information and control information use compression methods optimized for their specific structures, while payload data uses methods suited to its nature. This localized optimization ensures that each data portion is compressed efficiently without requiring excessive decompression time overall.
Solution Approach 2:
The patent applies compression selectively to only the necessary portions of data (headers and control information) that require efficient storage, rather than compressing all data uniformly. This partial application of compression reduces the total decompression burden while maintaining storage efficiency for critical data elements.
3Device complexity
If RAM capacity is limited in terminal apparatus, then device complexity is reduced, but data processing capability deteriorates
Solution Approach 1:
The patent moves data storage from the traditional single-dimension approach (internal RAM) to a multi-dimensional architecture involving external storage apparatus and selective data retention in internal memory. This dimensional shift allows the system to process data efficiently with limited RAM by only keeping essential data in fast memory while utilizing external storage for bulk data management.
Data Source
AI summary
In order to record communication data via a communication network, in a storage apparatus in accordance with an appropriate data recording method, a data processing apparatus includes: an obtaining unit configured to obtain communication data including one or more packets continuously communicated via a communication network; a recording unit configured to record the communication data in a storage; and a reading processing unit configured to read the communication data from the storage, wherein the recording unit selects a first data compression method from among a plurality of data compression methods based on compression rate for each data compression method, reading speed of the communication data from the storage, and decompression speed of the communication data required from reading of the communication data to decompression of the communication data in accordance with each compression method, and records the communication data in accordance with the first data compression method.